2022-10-12T02:00:35.626 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-12T02:00:35.768 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2022-10-12T02:00:35.769 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2022-10-12T02:00:35.769 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2022-10-12T02:00:35.793 INFO:teuthology.lock.ops:Node 'smithi096.front.sepia.ceph.com' reimaging is complete 2022-10-12T02:00:35.793 INFO:teuthology.lock.ops:Start node 'smithi109.front.sepia.ceph.com' reimaging 2022-10-12T02:00:35.794 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: reset os type and version on server 2022-10-12T02:00:35.794 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server 2022-10-12T02:00:35.816 INFO:teuthology.lock.ops:Node 'smithi109.front.sepia.ceph.com' reimaging is complete 2022-10-12T02:00:36.007 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of ubuntu 20.04 2022-10-12T02:00:36.027 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of ubuntu 20.04 2022-10-12T02:00:36.335 INFO:teuthology.orchestra.console:Power off smithi096 2022-10-12T02:00:36.381 INFO:teuthology.orchestra.console:Power off smithi109 2022-10-12T02:00:44.751 INFO:teuthology.orchestra.console:Power off for smithi109 completed 2022-10-12T02:00:44.853 INFO:teuthology.orchestra.console:Power on smithi109 2022-10-12T02:00:48.827 INFO:teuthology.orchestra.console:Power off for smithi096 completed 2022-10-12T02:00:48.929 INFO:teuthology.orchestra.console:Power on smithi096 2022-10-12T02:00:53.184 INFO:teuthology.orchestra.console:Power on for smithi096 completed 2022-10-12T02:00:53.217 INFO:teuthology.orchestra.console:Power on for smithi109 completed 2022-10-12T02:00:53.286 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2022-10-12T02:00:53.319 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish 2022-10-12T02:05:55.166 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-12T02:05:55.676 INFO:teuthology.provision.fog.smithi109:Node is ready 2022-10-12T02:05:55.683 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109.front.sepia.ceph.com 2022-10-12T02:05:55.690 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109 2022-10-12T02:05:55.835 INFO:teuthology.provision.fog.smithi109:Deploy complete! 2022-10-12T02:05:59.967 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-12T02:06:00.489 INFO:teuthology.provision.fog.smithi096:Node is ready 2022-10-12T02:06:00.495 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2022-10-12T02:06:00.549 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2022-10-12T02:06:00.687 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2022-10-12T02:06:00.969 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2022-10-12T02:06:01.053 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-12T02:06:01.075 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com 2022-10-12T02:06:01.075 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-12T02:06:01.095 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2022-10-12T02:06:01.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-10-12T02:06:01.301 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2022-10-12T02:06:01.308 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2022-10-12T02:06:01.308 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-12T02:06:01.309 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2022-10-12T02:06:01.309 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2022-10-12T02:06:01.309 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-12T02:06:01.309 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="20.04" 2022-10-12T02:06:01.309 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-12T02:06:01.310 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-12T02:06:01.310 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-12T02:06:01.310 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-12T02:06:01.310 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=focal 2022-10-12T02:06:01.310 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=focal 2022-10-12T02:06:01.312 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2022-10-12T02:06:01.331 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server 2022-10-12T02:06:01.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com' 2022-10-12T02:06:01.557 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64 2022-10-12T02:06:01.563 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="Ubuntu" 2022-10-12T02:06:01.563 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-12T02:06:01.564 INFO:teuthology.orchestra.run.smithi109.stdout:ID=ubuntu 2022-10-12T02:06:01.564 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE=debian 2022-10-12T02:06:01.564 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-12T02:06:01.565 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="20.04" 2022-10-12T02:06:01.565 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-12T02:06:01.565 INFO:teuthology.orchestra.run.smithi109.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-12T02:06:01.565 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-12T02:06:01.565 INFO:teuthology.orchestra.run.smithi109.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-12T02:06:01.566 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_CODENAME=focal 2022-10-12T02:06:01.566 INFO:teuthology.orchestra.run.smithi109.stdout:UBUNTU_CODENAME=focal 2022-10-12T02:06:01.566 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server 2022-10-12T02:06:01.663 INFO:teuthology.dispatcher.supervisor:Running job 7062792 2022-10-12T02:06:01.664 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-10-11_04:17:02-fs-pacific-distro-default-smithi/7062792 --name teuthology-2022-10-11_04:17:02-fs-pacific-distro-default-smithi --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/teuthology-2022-10-11_04:17:02-fs-pacific-distro-default-smithi/7062792/orig.config.yaml 2022-10-12T02:06:01.669 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-10-11_04:17:02-fs-pacific-distro-default-smithi/7062792 2022-10-12T02:06:01.669 INFO:teuthology.dispatcher.supervisor:Job PID: 29264 2022-10-12T02:06:01.670 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-12T14:06:24.411 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-12T14:06:24.644 INFO:teuthology.kill:Killing Pids: {29264} 2022-10-12T14:06:26.077 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-10-12T14:06:26.079 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-10-12T14:06:26.080 INFO:teuthology.misc:Compressing logs... 2022-10-12T14:06:26.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-10-12T14:06:26.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'