2021-10-07T19:35:22.737 INFO:root:teuthology version: 1.1.0-f08b273e
2021-10-07T19:35:22.912 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging
2021-10-07T19:35:22.913 INFO:teuthology.lock.ops:Updating [ubuntu@smithi109.front.sepia.ceph.com]: reset os type and version on server
2021-10-07T19:35:22.914 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2021-10-07T19:35:22.940 INFO:teuthology.lock.ops:Node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging is complete
2021-10-07T19:35:22.940 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi124.front.sepia.ceph.com' reimaging
2021-10-07T19:35:22.941 INFO:teuthology.lock.ops:Updating [ubuntu@smithi124.front.sepia.ceph.com]: reset os type and version on server
2021-10-07T19:35:22.941 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2021-10-07T19:35:22.964 INFO:teuthology.lock.ops:Node 'ubuntu@smithi124.front.sepia.ceph.com' reimaging is complete
2021-10-07T19:35:22.965 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging
2021-10-07T19:35:22.965 INFO:teuthology.lock.ops:Updating [ubuntu@smithi143.front.sepia.ceph.com]: reset os type and version on server
2021-10-07T19:35:22.965 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2021-10-07T19:35:22.987 INFO:teuthology.lock.ops:Node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging is complete
2021-10-07T19:35:23.161 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of centos 8.3
2021-10-07T19:35:23.182 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.3
2021-10-07T19:35:23.202 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.3
2021-10-07T19:35:23.540 INFO:teuthology.orchestra.console:Power off smithi109
2021-10-07T19:35:23.611 INFO:teuthology.orchestra.console:Power off smithi143
2021-10-07T19:35:23.625 INFO:teuthology.orchestra.console:Power off smithi124
2021-10-07T19:35:31.927 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2021-10-07T19:35:31.996 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2021-10-07T19:35:32.029 INFO:teuthology.orchestra.console:Power on smithi109
2021-10-07T19:35:32.100 INFO:teuthology.orchestra.console:Power on smithi124
2021-10-07T19:35:36.109 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-10-07T19:35:36.211 INFO:teuthology.orchestra.console:Power on smithi143
2021-10-07T19:35:40.409 INFO:teuthology.orchestra.console:Power on for smithi109 completed
2021-10-07T19:35:40.472 INFO:teuthology.orchestra.console:Power on for smithi124 completed
2021-10-07T19:35:40.511 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish
2021-10-07T19:35:40.574 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2021-10-07T19:35:44.574 INFO:teuthology.orchestra.console:Power on for smithi143 completed
2021-10-07T19:35:44.676 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2021-10-07T19:39:49.292 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-07T19:39:49.704 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-07T19:40:09.921 INFO:teuthology.provision.fog.smithi109:Node is ready
2021-10-07T19:40:09.940 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109.front.sepia.ceph.com
2021-10-07T19:40:09.998 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109
2021-10-07T19:40:10.366 INFO:teuthology.provision.fog.smithi109:Deploy complete!
2021-10-07T19:40:10.406 INFO:teuthology.provision.fog.smithi124:Node is ready
2021-10-07T19:40:10.425 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2021-10-07T19:40:10.481 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2021-10-07T19:40:10.835 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2021-10-07T19:40:16.882 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-07T19:40:17.186 INFO:teuthology.provision.fog.smithi143:Node is ready
2021-10-07T19:40:17.240 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com
2021-10-07T19:40:17.298 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143
2021-10-07T19:40:17.626 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2021-10-07T19:40:17.793 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com
2021-10-07T19:40:17.795 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-07T19:40:17.813 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2021-10-07T19:40:17.814 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-07T19:40:17.830 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2021-10-07T19:40:17.830 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-07T19:40:17.847 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server
2021-10-07T19:40:17.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2021-10-07T19:40:18.058 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64
2021-10-07T19:40:18.117 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="CentOS Linux"
2021-10-07T19:40:18.119 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="8"
2021-10-07T19:40:18.119 INFO:teuthology.orchestra.run.smithi109.stdout:ID="centos"
2021-10-07T19:40:18.120 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE="rhel fedora"
2021-10-07T19:40:18.120 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="8"
2021-10-07T19:40:18.120 INFO:teuthology.orchestra.run.smithi109.stdout:PLATFORM_ID="platform:el8"
2021-10-07T19:40:18.121 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="CentOS Linux 8"
2021-10-07T19:40:18.121 INFO:teuthology.orchestra.run.smithi109.stdout:ANSI_COLOR="0;31"
2021-10-07T19:40:18.123 INFO:teuthology.orchestra.run.smithi109.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-07T19:40:18.123 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://centos.org/"
2021-10-07T19:40:18.124 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-07T19:40:18.124 INFO:teuthology.orchestra.run.smithi109.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-07T19:40:18.125 INFO:teuthology.orchestra.run.smithi109.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-07T19:40:18.127 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2021-10-07T19:40:18.147 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2021-10-07T19:40:18.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2021-10-07T19:40:18.360 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2021-10-07T19:40:18.416 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Linux"
2021-10-07T19:40:18.417 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8"
2021-10-07T19:40:18.417 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2021-10-07T19:40:18.417 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2021-10-07T19:40:18.417 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8"
2021-10-07T19:40:18.418 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2021-10-07T19:40:18.418 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Linux 8"
2021-10-07T19:40:18.418 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2021-10-07T19:40:18.418 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-07T19:40:18.419 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2021-10-07T19:40:18.419 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-07T19:40:18.419 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-07T19:40:18.419 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-07T19:40:18.420 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2021-10-07T19:40:18.438 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2021-10-07T19:40:18.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com'
2021-10-07T19:40:18.705 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2021-10-07T19:40:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Linux"
2021-10-07T19:40:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8"
2021-10-07T19:40:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos"
2021-10-07T19:40:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora"
2021-10-07T19:40:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8"
2021-10-07T19:40:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8"
2021-10-07T19:40:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Linux 8"
2021-10-07T19:40:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31"
2021-10-07T19:40:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-07T19:40:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/"
2021-10-07T19:40:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-07T19:40:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-07T19:40:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-07T19:40:18.762 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2021-10-07T19:40:18.851 INFO:teuthology.dispatcher.supervisor:Running job 6426011
2021-10-07T19:40:18.851 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-10-07_18:20:16-rados-octopus-distro-basic-smithi/6426011 --name yuriw-2021-10-07_18:20:16-rados-octopus-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2021-10-07_18:20:16-rados-octopus-distro-basic-smithi/6426011/orig.config.yaml
2021-10-07T19:40:18.856 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-10-07_18:20:16-rados-octopus-distro-basic-smithi/6426011
2021-10-07T19:40:18.858 INFO:teuthology.dispatcher.supervisor:Job PID: 14784
2021-10-07T19:40:18.858 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-10-07T22:10:33.548 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2021-10-07_18:20:16-rados-octopus-distro-basic-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2021-10-08T07:41:17.608 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-10-08T07:41:17.811 INFO:teuthology.kill:Killing Pids: {14784}
2021-10-08T07:41:18.986 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2021-10-08T07:41:18.987 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2021-10-08T07:41:18.988 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2021-10-08T07:41:18.988 INFO:teuthology.misc:Compressing logs...
2021-10-08T07:41:18.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2021-10-08T07:41:19.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2021-10-08T07:41:19.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com'
2021-10-08T07:41:20.539 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-08T07:41:20.611 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-08T07:41:20.918 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-08T07:41:21.684 INFO:teuthology.kill:No teuthology processes running
2021-10-08T07:41:22.800 INFO:teuthology.kill:Nuking machines: ['smithi109', 'smithi124', 'smithi143']
2021-10-08T07:41:23.748 INFO:teuthology.kill:2021-10-08 07:41:23,748.748 INFO:teuthology.nuke:targets:
2021-10-08T07:41:23.749 INFO:teuthology.kill:  smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxH3pAZ3juZy3Z6w0d0j/G/3roSlrHYq+9FK2g2U+Iq+uw5qDQ1cFdU68f/GPOrV63KlMFH7wCT4v6hOn/o+XQ49iAgP+xLkU7TfJ0H2x0jcWAYQJ/P/yosjKD3VuMjzL6LTc2si0/fzjrjxbypjW5pYHKeVwr7KOw0zedQWE8qsJ3OTIG0jJs0dGe2loxusztq4eqFYZoFIIbbQ7nx45uEWC1Sxn9BZGUOGvEAaJBk3j0c8ivY6OcIxllaRhE+vnGKIVwrYynLzUIs5WXUs+Fc/fg6JZkPrF06aQe0TqSPIbY0ivKwyTNcvvoDEx5N80tT5R6AUr1uaNMjg1s14rVlEiJMayGt1flW1NQavcXFlPxS7a6YUBtj+e9VSBdMGXPUbJzis1etA1SYNA8QdA0nxOGLXMAC9xGLazDIxaigEU+fAyqkqkOCExK11cxF4sOO4/cYUiLkuvwHHHkTZ7veDSEGOT+jSDfgwpg1XKjd9jm4hbwcS9MLYKOAJimLdc=
2021-10-08T07:41:23.749 INFO:teuthology.kill:  smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXsAULkP41EZdKq6+SnSb1BOWBxWMEzA69vnUeLdEAKDUvbLG5lQdY9r9HEHgZqe76v8LjJTjXAUmsPEyJp5Od7kjGlXN78QV/CW1cgUdPqMyKei/MHw1lUYJD5tOlPMFTZrvnnxjn7HUgshpSVCJySjZ3rpv4ttZ+7D0jX7HfpzJULFkm0EJOEgJij4Lv+wjH+0jVwW+dDRglPoCr4HDeSZ0MmdLU5SLybm0lZ1xEHFzWDvCOYnz9qBgI6f3I7Yvc1TvkOGNL3A/GVL+efRZ8VN6P2S19/0tXp+pMVGd5AqV+CtCZZ7KW8ACVM68OUGaBnnQtA9EOavumYDT5HsxrrjJTVXQwPix+ryX7bl/eF1CC6kQ+3niIPYFoGy5Fjl8Qn0+b2wRDBjc5uIEh0hEYP+FbCPwsCy6cXnh12xkM2cuifr8mydy2OD7m8PTWbK6ap2h1L5b4t9vkyQhuVW7GUYmdFTui22OmicXcEFhS1m2RF0IyZLgVI/WSi8jAvVc=
2021-10-08T07:41:23.750 INFO:teuthology.kill:  smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC40WZxsKmp6aVOzmtmgP5wU5k80+upGslbENTyF3i23bKBn3pkyZv9WbniPOLl9s4T1x0MegpJsVTmF7+4oOFIH3LUtxWESE10g1m2/0GRNLjzQGGzSGTxzF+mse+Ma4+6R5VQHjWJyaIopntY7bY3diFEp4jXJy4kTt5xENDYhwbZIcus1fc6HTxq7L426Rsg0iNNrYfczFzWofuDS2Ax0T7k4TO/SWJJYreeJ9hWzcHrShDkq1y1Sdq+Tjo/eTszLdQqAaHpoz40h+/FoiNITrh5ypqR/yfajw3FHcQEoMSTV8OtzJKVrvpGUbXDL6cFbLEXQbMuQAlikkIeELfkJiqViX5B55x1FVHKXZPhea9KJ/yV9uEGRrl8k+oujd/rA49eM0XaMtp9YB1FVgRPyxzqjqpc59Afat1X/uCHRZRt255K7i0BJpUrFrNvEJLzjHX8i5loQ1UgtZJuKcP/3Nl1oZeyQEGqVRXteeyxbilNUSDBYP6umtLsaB88ufE=
2021-10-08T07:41:23.776 INFO:teuthology.kill:2021-10-08 07:41:23,775.775 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-08T07:41:23.780 INFO:teuthology.kill:2021-10-08 07:41:23,780.780 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-08T07:41:23.781 INFO:teuthology.kill:2021-10-08 07:41:23,781.781 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-08T07:41:23.849 INFO:teuthology.kill:2021-10-08 07:41:23,848.848 INFO:teuthology.orchestra.console:Power off smithi109
2021-10-08T07:41:23.863 INFO:teuthology.kill:2021-10-08 07:41:23,862.862 INFO:teuthology.orchestra.console:Power off smithi143
2021-10-08T07:41:23.874 INFO:teuthology.kill:2021-10-08 07:41:23,874.874 INFO:teuthology.orchestra.console:Power off smithi124
2021-10-08T07:41:32.230 INFO:teuthology.kill:2021-10-08 07:41:32,229.229 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2021-10-08T07:41:32.235 INFO:teuthology.kill:2021-10-08 07:41:32,235.235 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-10-08T07:41:32.369 INFO:teuthology.kill:2021-10-08 07:41:32,368.368 INFO:teuthology.lock.ops:unlocked: smithi109.front.sepia.ceph.com
2021-10-08T07:41:32.372 INFO:teuthology.kill:2021-10-08 07:41:32,372.372 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com
2021-10-08T07:41:36.357 INFO:teuthology.kill:2021-10-08 07:41:36,357.357 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2021-10-08T07:41:36.497 INFO:teuthology.kill:2021-10-08 07:41:36,497.497 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com
2021-10-08T07:43:36.797 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-10-08T07:43:36.915 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-10-08T07:43:36.915 INFO:teuthology.nuke:Checking targets against current locks
2021-10-08T07:43:37.068 INFO:teuthology.nuke:Not nuking smithi109.front.sepia.ceph.com because description doesn't match
2021-10-08T07:43:37.069 INFO:teuthology.nuke:Not nuking smithi143.front.sepia.ceph.com because description doesn't match
2021-10-08T07:43:37.069 INFO:teuthology.nuke:Not nuking smithi124.front.sepia.ceph.com because description doesn't match