2021-04-24T03:12:01.360 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-24T03:12:01.497 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging 2021-04-24T03:12:01.497 INFO:teuthology.lock.ops:Updating [ubuntu@smithi154.front.sepia.ceph.com]: reset os type and version on server 2021-04-24T03:12:01.497 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2021-04-24T03:12:01.518 INFO:teuthology.lock.ops:Node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging is complete 2021-04-24T03:12:01.518 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging 2021-04-24T03:12:01.518 INFO:teuthology.lock.ops:Updating [ubuntu@smithi159.front.sepia.ceph.com]: reset os type and version on server 2021-04-24T03:12:01.518 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2021-04-24T03:12:01.541 INFO:teuthology.lock.ops:Node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging is complete 2021-04-24T03:12:01.542 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging 2021-04-24T03:12:01.542 INFO:teuthology.lock.ops:Updating [ubuntu@smithi191.front.sepia.ceph.com]: reset os type and version on server 2021-04-24T03:12:01.542 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2021-04-24T03:12:01.556 INFO:teuthology.lock.ops:Node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging is complete 2021-04-24T03:12:01.737 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.3 2021-04-24T03:12:01.751 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.3 2021-04-24T03:12:01.762 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.3 2021-04-24T03:12:02.107 INFO:teuthology.orchestra.console:Power off smithi154 2021-04-24T03:12:02.125 INFO:teuthology.orchestra.console:Power off smithi159 2021-04-24T03:12:02.148 INFO:teuthology.orchestra.console:Power off smithi191 2021-04-24T03:12:10.517 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2021-04-24T03:12:10.618 INFO:teuthology.orchestra.console:Power on smithi159 2021-04-24T03:12:14.603 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2021-04-24T03:12:14.634 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-04-24T03:12:14.704 INFO:teuthology.orchestra.console:Power on smithi154 2021-04-24T03:12:14.742 INFO:teuthology.orchestra.console:Power on smithi191 2021-04-24T03:12:18.983 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2021-04-24T03:12:18.996 INFO:teuthology.orchestra.console:Power on for smithi191 completed 2021-04-24T03:12:19.084 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2021-04-24T03:12:19.098 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2021-04-24T03:12:23.081 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2021-04-24T03:12:23.182 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2021-04-24T03:15:54.623 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: Authentication timeout. 2021-04-24T03:16:36.327 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-24T03:16:56.682 INFO:teuthology.provision.fog.smithi154:Node is ready 2021-04-24T03:16:56.701 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2021-04-24T03:16:56.758 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2021-04-24T03:16:57.108 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2021-04-24T03:17:06.023 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-24T03:17:06.088 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-24T03:17:06.356 INFO:teuthology.provision.fog.smithi159:Node is ready 2021-04-24T03:17:06.371 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2021-04-24T03:17:06.387 INFO:teuthology.provision.fog.smithi191:Node is ready 2021-04-24T03:17:06.401 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2021-04-24T03:17:06.423 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2021-04-24T03:17:06.456 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2021-04-24T03:17:06.746 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2021-04-24T03:17:06.786 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2021-04-24T03:17:06.925 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2021-04-24T03:17:06.925 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-24T03:17:06.948 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2021-04-24T03:17:06.949 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-24T03:17:06.962 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2021-04-24T03:17:06.962 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-24T03:17:06.975 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2021-04-24T03:17:06.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-24T03:17:07.196 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2021-04-24T03:17:07.251 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Linux" 2021-04-24T03:17:07.251 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Linux 8" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-04-24T03:17:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-04-24T03:17:07.253 INFO:teuthology.orchestra.run.smithi154.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-04-24T03:17:07.254 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2021-04-24T03:17:07.272 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2021-04-24T03:17:07.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-24T03:17:07.556 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2021-04-24T03:17:07.610 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Linux" 2021-04-24T03:17:07.610 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2021-04-24T03:17:07.610 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2021-04-24T03:17:07.610 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2021-04-24T03:17:07.610 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2021-04-24T03:17:07.610 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2021-04-24T03:17:07.611 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Linux 8" 2021-04-24T03:17:07.611 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2021-04-24T03:17:07.611 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-04-24T03:17:07.611 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2021-04-24T03:17:07.611 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-04-24T03:17:07.611 INFO:teuthology.orchestra.run.smithi159.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-04-24T03:17:07.611 INFO:teuthology.orchestra.run.smithi159.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-04-24T03:17:07.612 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2021-04-24T03:17:07.645 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2021-04-24T03:17:07.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-24T03:17:07.927 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2021-04-24T03:17:07.981 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Linux" 2021-04-24T03:17:07.981 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2021-04-24T03:17:07.981 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2021-04-24T03:17:07.981 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Linux 8" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-04-24T03:17:07.982 INFO:teuthology.orchestra.run.smithi191.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-04-24T03:17:07.983 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2021-04-24T03:17:08.067 INFO:teuthology.dispatcher.supervisor:Running job 6069162 2021-04-24T03:17:08.067 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_sseshasa@teuthology --archive /home/teuthworker/archive/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/6069162 --name sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/6069162/orig.config.yaml 2021-04-24T03:17:08.071 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/6069162 2021-04-24T03:17:08.072 INFO:teuthology.dispatcher.supervisor:Job PID: 29473 2021-04-24T03:17:08.072 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-04-24T03:17:13.691 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-04-24T05:46:42.384 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-24T07:12:29.262 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-24T09:50:37.907 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-24T10:00:24.446 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-24T11:12:19.728 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-24T13:04:32.150 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-24T14:50:35.615 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/sseshasa-2021-04-23_18:11:53-rados-wip-sseshasa-testing-2021-04-23-2212-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-24T15:17:32.312 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-04-24T15:17:32.520 INFO:teuthology.kill:Killing Pids: {29473} 2021-04-24T15:18:21.560 INFO:teuthology.kill:Nuking machines: ['smithi154', 'smithi159', 'smithi191'] 2021-04-24T15:18:22.523 INFO:teuthology.kill:2021-04-24 15:18:22,523.523 INFO:teuthology.nuke:targets: 2021-04-24T15:18:22.523 INFO:teuthology.kill: smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFncdDxpmSOSh7Y8HEgw1rcx3kr8+tmbsG+ZU5wKL4dLg9cvcCH/GPvHteff0v0aXtAfkWlk1aN1fY0xFslez0CqQdY16J8tW84eVys78yrIsH0sma/M2AKEfJFQ02zf7G5DPLGYEVfs8WNZCwryTZ4sjEoXl8fYJfgbj2ElciedH1gc+jpjtAXHhWQdEAoPSKIIlVk5yBM05DuuKHpeZ7pnsxWMaX4tmWbZODJSuzk8zjajzlC6pqahJkmmUyFfguyEntfTWOgPJydWGNq8N5TQMGNVRf1FWjNoUoKlG0iYIDkXgrSB1jO7TBMny6GjcmupH3Go1Buu0FwnQkxx833pVL/UqF0XXootowIJo7APXy3Fwe37G2cv0+M/JqW5QSuxYQTtWvE+r6DYO0ybHCcFFFPa6W5yICwkZXoTwuEPKUq+wPlJ34idKlzHe3RPRjYIPcSyHDT9QAMDBPIIz4H1+ByLCaMJ2fFB5AvLeLvZrkbA6YVCl0JuQQYk365B0= 2021-04-24T15:18:22.524 INFO:teuthology.kill: smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+6IL6zuMG7Or/jw6vSAxS5h6Cc2cJoBu8n4+z9M7nUYvLDxs601uUknHjCCJBJBVA9YEc4wVctxfOfcG6i0C1y5QyQ7vTIkfXgMqLSWGGW66jOQV5Ys1b+7QugD94b0Uln325Jo16DfhOYkQF6B46m9TElRJlcVlR1zOi1DXH5vvD9jAcRJBKUehJF2Fb2Z3mKo4qrEapLepgOxsslZXTQlZKNWCJm3z5XCqS0j/QMv+qUW/hgGPhvMFFyGtSXBb+sbRe4mB3u9S+mvI0+1fEzZ7tf3SfqW8J3VhHIZtAJ+ujVNxArS22SvZ28Cyghzq23cFsSZ/GgaUTT8cQBOsn8USXtlaACVglHqqM1DeQ8KxFJOK5dCA56rIZKRcUVSnJeC/JEsbgsslo0GroLUJlpZEuePegwrH8La5wIwBieTE99luWQVy61qBppLCDik/d1uscySDg6x/IYpMcVRwmh4wQ+GR9PiPHSuDmcbVfFmO3WLH1+lDm7adZ7FsfZXM= 2021-04-24T15:18:22.524 INFO:teuthology.kill: smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC59ryaePRoV84sUMoM1wMgc+xfcomwc850EW11+Ep9YojPpLiX5RCGyO8d9IHqlUBuju/ayOY7zImca65CxU/jVzVMd6z45MCLAVg2lhU0m3vaJUPQbtiB14xC5YvCKb0Uz30GSfYUF3ySPKu1zHY8NLJn0PK3A5GzMoFiyydw6Ex3e8mGZlJvHoqgS+IKR67VIBziB0eHxu5V54Kp2yUYSXC9mNFCZi9R4gyk8tBLf0LgniY6EsNj1iA7ebE1fxlR6m70brZ3j4p1bLEO3Ltz2OWxWOYnlTGk95qSeWvDZuadR9oPyvBslVF9v6Xg3f1Vb7wny1QAWwi+AczuU1HvTOyi/dhUTWZll8xhZmRUET/IY0HAPHwsnPqsuXG+rV3aqTJ0npvEe46zmJ1Cv/tcAbb5rzO8lTa2oCPimgnXquKqzkZLy6H1G3C0hy1XL/TrBNpfBp7L1rTAr/gciBo6zWbz03/QrfT9QsQRf+Pgmf8cJPljQu5jpmTYbNmETJc= 2021-04-24T15:18:22.524 INFO:teuthology.kill:2021-04-24 15:18:22,523.523 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-24T15:18:22.526 INFO:teuthology.kill:2021-04-24 15:18:22,526.526 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-24T15:18:22.527 INFO:teuthology.kill:2021-04-24 15:18:22,527.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-24T15:18:24.718 INFO:teuthology.kill:2021-04-24 15:18:24,717.717 INFO:teuthology.orchestra.console:Power off smithi159 2021-04-24T15:18:24.734 INFO:teuthology.kill:2021-04-24 15:18:24,734.734 INFO:teuthology.orchestra.console:Power off smithi154 2021-04-24T15:18:24.748 INFO:teuthology.kill:2021-04-24 15:18:24,747.747 INFO:teuthology.orchestra.console:Power off smithi191 2021-04-24T15:18:33.110 INFO:teuthology.kill:2021-04-24 15:18:33,110.110 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2021-04-24T15:18:37.218 INFO:teuthology.kill:2021-04-24 15:18:37,218.218 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2021-04-24T15:18:37.223 INFO:teuthology.kill:2021-04-24 15:18:37,223.223 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-04-24T15:18:37.465 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a'] 2021-04-24T15:18:37.465 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x'] 2021-04-24T15:18:37.465 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c'] 2021-04-24T15:18:37.465 INFO:teuthology.misc:Compressing logs... 2021-04-24T15:18:37.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-24T15:18:55.835 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-04-24T15:18:55.896 INFO:teuthology.kill:No teuthology processes running 2021-04-24T15:18:56.910 INFO:teuthology.kill:Nuking machines: ['smithi154', 'smithi159', 'smithi191'] 2021-04-24T15:18:57.822 INFO:teuthology.kill:2021-04-24 15:18:57,822.822 INFO:teuthology.nuke:targets: 2021-04-24T15:18:57.822 INFO:teuthology.kill: smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFncdDxpmSOSh7Y8HEgw1rcx3kr8+tmbsG+ZU5wKL4dLg9cvcCH/GPvHteff0v0aXtAfkWlk1aN1fY0xFslez0CqQdY16J8tW84eVys78yrIsH0sma/M2AKEfJFQ02zf7G5DPLGYEVfs8WNZCwryTZ4sjEoXl8fYJfgbj2ElciedH1gc+jpjtAXHhWQdEAoPSKIIlVk5yBM05DuuKHpeZ7pnsxWMaX4tmWbZODJSuzk8zjajzlC6pqahJkmmUyFfguyEntfTWOgPJydWGNq8N5TQMGNVRf1FWjNoUoKlG0iYIDkXgrSB1jO7TBMny6GjcmupH3Go1Buu0FwnQkxx833pVL/UqF0XXootowIJo7APXy3Fwe37G2cv0+M/JqW5QSuxYQTtWvE+r6DYO0ybHCcFFFPa6W5yICwkZXoTwuEPKUq+wPlJ34idKlzHe3RPRjYIPcSyHDT9QAMDBPIIz4H1+ByLCaMJ2fFB5AvLeLvZrkbA6YVCl0JuQQYk365B0= 2021-04-24T15:18:57.823 INFO:teuthology.kill: smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+6IL6zuMG7Or/jw6vSAxS5h6Cc2cJoBu8n4+z9M7nUYvLDxs601uUknHjCCJBJBVA9YEc4wVctxfOfcG6i0C1y5QyQ7vTIkfXgMqLSWGGW66jOQV5Ys1b+7QugD94b0Uln325Jo16DfhOYkQF6B46m9TElRJlcVlR1zOi1DXH5vvD9jAcRJBKUehJF2Fb2Z3mKo4qrEapLepgOxsslZXTQlZKNWCJm3z5XCqS0j/QMv+qUW/hgGPhvMFFyGtSXBb+sbRe4mB3u9S+mvI0+1fEzZ7tf3SfqW8J3VhHIZtAJ+ujVNxArS22SvZ28Cyghzq23cFsSZ/GgaUTT8cQBOsn8USXtlaACVglHqqM1DeQ8KxFJOK5dCA56rIZKRcUVSnJeC/JEsbgsslo0GroLUJlpZEuePegwrH8La5wIwBieTE99luWQVy61qBppLCDik/d1uscySDg6x/IYpMcVRwmh4wQ+GR9PiPHSuDmcbVfFmO3WLH1+lDm7adZ7FsfZXM= 2021-04-24T15:18:57.823 INFO:teuthology.kill: smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC59ryaePRoV84sUMoM1wMgc+xfcomwc850EW11+Ep9YojPpLiX5RCGyO8d9IHqlUBuju/ayOY7zImca65CxU/jVzVMd6z45MCLAVg2lhU0m3vaJUPQbtiB14xC5YvCKb0Uz30GSfYUF3ySPKu1zHY8NLJn0PK3A5GzMoFiyydw6Ex3e8mGZlJvHoqgS+IKR67VIBziB0eHxu5V54Kp2yUYSXC9mNFCZi9R4gyk8tBLf0LgniY6EsNj1iA7ebE1fxlR6m70brZ3j4p1bLEO3Ltz2OWxWOYnlTGk95qSeWvDZuadR9oPyvBslVF9v6Xg3f1Vb7wny1QAWwi+AczuU1HvTOyi/dhUTWZll8xhZmRUET/IY0HAPHwsnPqsuXG+rV3aqTJ0npvEe46zmJ1Cv/tcAbb5rzO8lTa2oCPimgnXquKqzkZLy6H1G3C0hy1XL/TrBNpfBp7L1rTAr/gciBo6zWbz03/QrfT9QsQRf+Pgmf8cJPljQu5jpmTYbNmETJc= 2021-04-24T15:18:57.845 INFO:teuthology.kill:2021-04-24 15:18:57,844.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-24T15:18:57.857 INFO:teuthology.kill:2021-04-24 15:18:57,857.857 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-24T15:18:57.870 INFO:teuthology.kill:2021-04-24 15:18:57,870.870 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-24T15:18:57.964 INFO:teuthology.kill:2021-04-24 15:18:57,963.963 INFO:teuthology.orchestra.console:Power off smithi159 2021-04-24T15:18:57.976 INFO:teuthology.kill:2021-04-24 15:18:57,976.976 INFO:teuthology.orchestra.console:Power off smithi154 2021-04-24T15:18:57.989 INFO:teuthology.kill:2021-04-24 15:18:57,989.989 INFO:teuthology.orchestra.console:Power off smithi191 2021-04-24T15:18:58.119 INFO:teuthology.kill:2021-04-24 15:18:58,118.118 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2021-04-24T15:18:58.123 INFO:teuthology.kill:2021-04-24 15:18:58,123.123 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2021-04-24T15:18:58.130 INFO:teuthology.kill:2021-04-24 15:18:58,129.129 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-04-24T15:18:58.284 INFO:teuthology.kill:2021-04-24 15:18:58,284.284 INFO:teuthology.lock.ops:unlocked smithi159.front.sepia.ceph.com 2021-04-24T15:18:58.300 INFO:teuthology.kill:2021-04-24 15:18:58,300.300 INFO:teuthology.lock.ops:unlocked smithi154.front.sepia.ceph.com 2021-04-24T15:18:58.317 INFO:teuthology.kill:2021-04-24 15:18:58,316.316 INFO:teuthology.lock.ops:unlocked smithi191.front.sepia.ceph.com 2021-04-24T15:20:58.591 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-04-24T15:20:58.697 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-04-24T15:20:58.697 INFO:teuthology.nuke:Checking targets against current locks 2021-04-24T15:20:58.788 INFO:teuthology.nuke:Not nuking smithi191.front.sepia.ceph.com because description doesn't match 2021-04-24T15:20:58.788 INFO:teuthology.nuke:Not nuking smithi154.front.sepia.ceph.com because description doesn't match 2021-04-24T15:20:58.788 INFO:teuthology.nuke:Not nuking smithi159.front.sepia.ceph.com because description doesn't match