2021-10-21T23:59:29.377 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-21T23:59:29.507 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2021-10-21T23:59:29.508 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2021-10-21T23:59:29.508 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2021-10-21T23:59:29.527 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2021-10-21T23:59:29.527 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging 2021-10-21T23:59:29.527 INFO:teuthology.lock.ops:Updating [ubuntu@smithi165.front.sepia.ceph.com]: reset os type and version on server 2021-10-21T23:59:29.528 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2021-10-21T23:59:29.547 INFO:teuthology.lock.ops:Node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging is complete 2021-10-21T23:59:29.811 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.3 2021-10-21T23:59:29.833 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.3 2021-10-21T23:59:30.359 INFO:teuthology.orchestra.console:Power off smithi163 2021-10-21T23:59:30.490 INFO:teuthology.orchestra.console:Power off smithi165 2021-10-21T23:59:38.729 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2021-10-21T23:59:38.831 INFO:teuthology.orchestra.console:Power on smithi163 2021-10-21T23:59:42.978 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2021-10-21T23:59:43.080 INFO:teuthology.orchestra.console:Power on smithi165 2021-10-21T23:59:47.191 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2021-10-21T23:59:47.293 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2021-10-21T23:59:47.333 INFO:teuthology.orchestra.console:Power on for smithi165 completed 2021-10-21T23:59:47.434 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2021-10-22T00:04:52.352 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-22T00:04:52.628 INFO:teuthology.provision.fog.smithi165:Node is ready 2021-10-22T00:04:52.684 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com 2021-10-22T00:04:52.739 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165 2021-10-22T00:04:53.086 INFO:teuthology.provision.fog.smithi165:Deploy complete! 2021-10-22T00:05:07.276 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-22T00:05:07.610 INFO:teuthology.provision.fog.smithi163:Node is ready 2021-10-22T00:05:07.626 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2021-10-22T00:05:07.683 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2021-10-22T00:05:08.015 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2021-10-22T00:05:08.185 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2021-10-22T00:05:08.186 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-22T00:05:08.207 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com 2021-10-22T00:05:08.208 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-22T00:05:08.228 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2021-10-22T00:05:08.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2021-10-22T00:05:08.430 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2021-10-22T00:05:08.486 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Linux" 2021-10-22T00:05:08.486 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2021-10-22T00:05:08.486 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2021-10-22T00:05:08.486 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2021-10-22T00:05:08.487 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2021-10-22T00:05:08.487 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2021-10-22T00:05:08.487 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-22T00:05:08.487 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2021-10-22T00:05:08.488 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-22T00:05:08.488 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2021-10-22T00:05:08.488 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-22T00:05:08.488 INFO:teuthology.orchestra.run.smithi163.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-22T00:05:08.488 INFO:teuthology.orchestra.run.smithi163.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-22T00:05:08.490 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2021-10-22T00:05:08.509 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server 2021-10-22T00:05:08.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2021-10-22T00:05:08.784 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2021-10-22T00:05:08.842 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Linux" 2021-10-22T00:05:08.842 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8" 2021-10-22T00:05:08.842 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2021-10-22T00:05:08.843 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2021-10-22T00:05:08.843 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8" 2021-10-22T00:05:08.843 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2021-10-22T00:05:08.843 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-22T00:05:08.844 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2021-10-22T00:05:08.844 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-22T00:05:08.844 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2021-10-22T00:05:08.844 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-22T00:05:08.845 INFO:teuthology.orchestra.run.smithi165.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-22T00:05:08.845 INFO:teuthology.orchestra.run.smithi165.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-22T00:05:08.845 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2021-10-22T00:05:08.957 INFO:teuthology.dispatcher.supervisor:Running job 6455757 2021-10-22T00:05:08.958 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-10-21_13:52:58-rados-wip-yuri7-testing-2021-10-20-1628-distro-basic-smithi/6455757 --name yuriw-2021-10-21_13:52:58-rados-wip-yuri7-testing-2021-10-20-1628-distro-basic-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} -- /home/teuthworker/archive/yuriw-2021-10-21_13:52:58-rados-wip-yuri7-testing-2021-10-20-1628-distro-basic-smithi/6455757/orig.config.yaml 2021-10-22T00:05:08.961 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-10-21_13:52:58-rados-wip-yuri7-testing-2021-10-20-1628-distro-basic-smithi/6455757 2021-10-22T00:05:08.962 INFO:teuthology.dispatcher.supervisor:Job PID: 26461 2021-10-22T00:05:08.962 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-10-22T12:06:01.888 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-10-22T12:06:02.116 INFO:teuthology.kill:Killing Pids: {26461} 2021-10-22T12:06:03.398 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-10-22T12:06:03.399 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-10-22T12:06:03.399 INFO:teuthology.misc:Compressing logs... 2021-10-22T12:06:03.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2021-10-22T12:06:03.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2021-10-22T12:06:04.041 INFO:teuthology.misc:Compressing logs... 2021-10-22T12:06:05.158 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-22T12:06:05.185 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-22T12:06:34.962 INFO:teuthology.misc:Compressing logs... 2021-10-22T12:06:54.062 INFO:teuthology.kill:No teuthology processes running 2021-10-22T12:06:55.249 INFO:teuthology.kill:Nuking machines: ['smithi163', 'smithi165'] 2021-10-22T12:06:56.233 INFO:teuthology.kill:2021-10-22 12:06:56,232.232 INFO:teuthology.nuke:targets: 2021-10-22T12:06:56.234 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgzmgz49eLNjiLnXjgyo7kV2XFa9TWIvP0Edt59uGZ0k8aAAP9BmQIDuuKZXLrD+mJ4E9npj2pZEFy8EEv8JR3ijRpQQemawYp6H3q+3fJv6MJdCG4yM6UB51bekrm4GubEX5xOFu1bIdTf3ERhVub74EORaZnWK8ook7HRwh8dFrs9qzrZuAge1TUfv44wzJPf53IUxkLUjwqiOuOJRvtO+tsOAvXMiDeg9zl2mSgy11c7EYbTu2MaQHll4zrEpdSfH+QHYFeAzikWPGDT+rD6nrZEr5tRMTxSdOZtARtZsJo+pK/LzcRNxopTfZVoaIVeKAz/GU8XMJZsDxuqbsMPhLsrifkIGc/XC7ggfznjlo+lEhUIQURmPMxwT505Oc4YrqusSLLbpxITBHXeFMyrnbwAgOIQTlPFRFHNmUt/v7xDmEXoObeQTGWbFveYzCpXimoDVxT79sYJRLMU++ORm1zxPkYlyyuoXMVhucG6dLWVaH+YMquT7GkwLBy7GU= 2021-10-22T12:06:56.234 INFO:teuthology.kill: smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX6OvCI3MTlLWgvzeC09E5Rzbn7z0cmWYyuf/6fDytMY+Vh3/0Y9csaPs11TL/P+YirZCPw5bbFdnZlwEul69+plc+wTYOHWD4Agy1wvDUWu82fcz428igX3dSJ2rMuqmgGwnlF5cBK2N2jkviv/XnkhE9ZhRPw6hu3h5Kfm8Khs4ONu6CtfcjkdWl7/iVJEJ192Npc6Jn9GLjSyLX+8cSjLzuVYvtPblHOse71Ax3uG3gSB5IwpoWnH8hS+txZxRtQ7TqZaOCzObJM0/ZtQA0tbjGXKtbmgAyvL63fa9ZleaB8hUCxAV/C8CzPXfXQ6aCuUY+9PqE6mN3R8nTBfvI2Yaoi6kR2cWJjn63mjT8Nus5wJSgy7F9pFGwLSHNOHGW9qDLPRvs/531YhsFutbYI4cspQHd2+MZKommxlFZcT+9rvc0MHG7NXiH8shtL5/Mhhy+2TjKqQT4Iy4yp9p0EGknr/5kjs0/kWBuHi3DpH7sUpulRxn8r2Y5X0Jlmgk= 2021-10-22T12:06:56.260 INFO:teuthology.kill:2021-10-22 12:06:56,260.260 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-22T12:06:56.265 INFO:teuthology.kill:2021-10-22 12:06:56,265.265 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-22T12:06:56.340 INFO:teuthology.kill:2021-10-22 12:06:56,340.340 INFO:teuthology.orchestra.console:Power off smithi165 2021-10-22T12:06:56.355 INFO:teuthology.kill:2021-10-22 12:06:56,354.354 INFO:teuthology.orchestra.console:Power off smithi163 2021-10-22T12:07:04.725 INFO:teuthology.kill:2021-10-22 12:07:04,724.724 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2021-10-22T12:07:04.923 INFO:teuthology.kill:2021-10-22 12:07:04,923.923 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2021-10-22T12:07:08.824 INFO:teuthology.kill:2021-10-22 12:07:08,823.823 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2021-10-22T12:07:08.970 INFO:teuthology.kill:2021-10-22 12:07:08,970.970 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com 2021-10-22T12:09:09.286 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-10-22T12:09:09.415 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/trociny-2021-10-22_10:01:47-rbd-wip-mgolub-testing-distro-basic-smithi/6457233 2021-10-22T12:09:09.415 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi165 but it was locked by another job: /home/teuthworker/archive/trociny-2021-10-22_10:01:47-rbd-wip-mgolub-testing-distro-basic-smithi/6457235