2021-06-04T13:28:33.995 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-04T13:28:34.125 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging 2021-06-04T13:28:34.126 INFO:teuthology.lock.ops:Updating [ubuntu@smithi084.front.sepia.ceph.com]: reset os type and version on server 2021-06-04T13:28:34.126 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2021-06-04T13:28:34.142 INFO:teuthology.lock.ops:Node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging is complete 2021-06-04T13:28:34.143 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging 2021-06-04T13:28:34.143 INFO:teuthology.lock.ops:Updating [ubuntu@smithi110.front.sepia.ceph.com]: reset os type and version on server 2021-06-04T13:28:34.143 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2021-06-04T13:28:34.161 INFO:teuthology.lock.ops:Node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging is complete 2021-06-04T13:28:34.161 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi199.front.sepia.ceph.com' reimaging 2021-06-04T13:28:34.161 INFO:teuthology.lock.ops:Updating [ubuntu@smithi199.front.sepia.ceph.com]: reset os type and version on server 2021-06-04T13:28:34.162 INFO:teuthology.lock.ops:Updating smithi199.front.sepia.ceph.com on lock server 2021-06-04T13:28:34.176 INFO:teuthology.lock.ops:Node 'ubuntu@smithi199.front.sepia.ceph.com' reimaging is complete 2021-06-04T13:28:34.333 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.3 2021-06-04T13:28:34.355 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.3 2021-06-04T13:28:34.362 INFO:teuthology.provision.fog.smithi199:Scheduling deploy of rhel 8.3 2021-06-04T13:28:34.708 INFO:teuthology.orchestra.console:Power off smithi110 2021-06-04T13:28:34.722 INFO:teuthology.orchestra.console:Power off smithi084 2021-06-04T13:28:34.754 INFO:teuthology.orchestra.console:Power off smithi199 2021-06-04T13:28:43.092 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2021-06-04T13:28:43.096 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2021-06-04T13:28:43.121 INFO:teuthology.orchestra.console:Power off for smithi199 completed 2021-06-04T13:28:43.195 INFO:teuthology.orchestra.console:Power on smithi084 2021-06-04T13:28:43.204 INFO:teuthology.orchestra.console:Power on smithi110 2021-06-04T13:28:43.223 INFO:teuthology.orchestra.console:Power on smithi199 2021-06-04T13:28:51.593 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2021-06-04T13:28:51.609 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2021-06-04T13:28:51.611 INFO:teuthology.orchestra.console:Power on for smithi199 completed 2021-06-04T13:28:51.695 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2021-06-04T13:28:51.711 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2021-06-04T13:28:51.713 INFO:teuthology.provision.fog.smithi199:Waiting for deploy to finish 2021-06-04T13:32:58.210 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-04T13:32:58.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-04T13:33:18.477 INFO:teuthology.provision.fog.smithi110:Node is ready 2021-06-04T13:33:18.496 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2021-06-04T13:33:18.553 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2021-06-04T13:33:18.793 INFO:teuthology.provision.fog.smithi199:Node is ready 2021-06-04T13:33:18.812 INFO:teuthology.orchestra.run.smithi199.stdout:smithi199.front.sepia.ceph.com 2021-06-04T13:33:18.868 INFO:teuthology.orchestra.run.smithi199.stdout:172.21.15.199 smithi199.front.sepia.ceph.com smithi199 2021-06-04T13:33:18.910 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2021-06-04T13:33:19.229 INFO:teuthology.provision.fog.smithi199:Deploy complete! 2021-06-04T13:33:23.560 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-04T13:33:23.881 INFO:teuthology.provision.fog.smithi084:Node is ready 2021-06-04T13:33:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2021-06-04T13:33:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2021-06-04T13:33:24.269 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2021-06-04T13:33:24.411 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2021-06-04T13:33:24.412 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-04T13:33:24.428 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2021-06-04T13:33:24.429 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-04T13:33:24.445 INFO:teuthology.lock.ops:Checking smithi199.front.sepia.ceph.com 2021-06-04T13:33:24.445 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-04T13:33:24.460 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2021-06-04T13:33:24.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-04T13:33:24.671 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2021-06-04T13:33:24.725 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2021-06-04T13:33:24.725 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.3 (Ootpa)" 2021-06-04T13:33:24.725 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2021-06-04T13:33:24.726 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2021-06-04T13:33:24.726 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.3" 2021-06-04T13:33:24.726 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2021-06-04T13:33:24.726 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-06-04T13:33:24.726 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2021-06-04T13:33:24.727 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-06-04T13:33:24.727 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2021-06-04T13:33:24.727 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-06-04T13:33:24.727 INFO:teuthology.orchestra.run.smithi084.stdout: 2021-06-04T13:33:24.728 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-06-04T13:33:24.728 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-06-04T13:33:24.728 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-06-04T13:33:24.728 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-06-04T13:33:24.730 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2021-06-04T13:33:24.745 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2021-06-04T13:33:24.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-04T13:33:25.035 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2021-06-04T13:33:25.089 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2021-06-04T13:33:25.089 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.3 (Ootpa)" 2021-06-04T13:33:25.089 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2021-06-04T13:33:25.090 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2021-06-04T13:33:25.090 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.3" 2021-06-04T13:33:25.090 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2021-06-04T13:33:25.090 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-06-04T13:33:25.091 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2021-06-04T13:33:25.091 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-06-04T13:33:25.091 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2021-06-04T13:33:25.091 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-06-04T13:33:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-06-04T13:33:25.092 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-06-04T13:33:25.092 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-06-04T13:33:25.092 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-06-04T13:33:25.092 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-06-04T13:33:25.093 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2021-06-04T13:33:25.110 INFO:teuthology.lock.ops:Updating [smithi199.front.sepia.ceph.com]: set os type and version on server 2021-06-04T13:33:25.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-04T13:33:25.336 INFO:teuthology.orchestra.run.smithi199.stdout:x86_64 2021-06-04T13:33:25.392 INFO:teuthology.orchestra.run.smithi199.stdout:NAME="Red Hat Enterprise Linux" 2021-06-04T13:33:25.393 INFO:teuthology.orchestra.run.smithi199.stdout:VERSION="8.3 (Ootpa)" 2021-06-04T13:33:25.393 INFO:teuthology.orchestra.run.smithi199.stdout:ID="rhel" 2021-06-04T13:33:25.393 INFO:teuthology.orchestra.run.smithi199.stdout:ID_LIKE="fedora" 2021-06-04T13:33:25.393 INFO:teuthology.orchestra.run.smithi199.stdout:VERSION_ID="8.3" 2021-06-04T13:33:25.394 INFO:teuthology.orchestra.run.smithi199.stdout:PLATFORM_ID="platform:el8" 2021-06-04T13:33:25.394 INFO:teuthology.orchestra.run.smithi199.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-06-04T13:33:25.394 INFO:teuthology.orchestra.run.smithi199.stdout:ANSI_COLOR="0;31" 2021-06-04T13:33:25.395 INFO:teuthology.orchestra.run.smithi199.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-06-04T13:33:25.395 INFO:teuthology.orchestra.run.smithi199.stdout:HOME_URL="https://www.redhat.com/" 2021-06-04T13:33:25.395 INFO:teuthology.orchestra.run.smithi199.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-06-04T13:33:25.396 INFO:teuthology.orchestra.run.smithi199.stdout: 2021-06-04T13:33:25.396 INFO:teuthology.orchestra.run.smithi199.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-06-04T13:33:25.396 INFO:teuthology.orchestra.run.smithi199.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-06-04T13:33:25.396 INFO:teuthology.orchestra.run.smithi199.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-06-04T13:33:25.396 INFO:teuthology.orchestra.run.smithi199.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-06-04T13:33:25.397 INFO:teuthology.lock.ops:Updating smithi199.front.sepia.ceph.com on lock server 2021-06-04T13:33:25.481 INFO:teuthology.dispatcher.supervisor:Running job 6149564 2021-06-04T13:33:25.483 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-06-03_14:47:27-rados-final_gbenhano_ncb-distro-basic-smithi/6149564 --name benhanokh-2021-06-03_14:47:27-rados-final_gbenhano_ncb-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/archive/benhanokh-2021-06-03_14:47:27-rados-final_gbenhano_ncb-distro-basic-smithi/6149564/orig.config.yaml 2021-06-04T13:33:25.488 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-06-03_14:47:27-rados-final_gbenhano_ncb-distro-basic-smithi/6149564 2021-06-04T13:33:25.488 INFO:teuthology.dispatcher.supervisor:Job PID: 31040 2021-06-04T13:33:25.489 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-06-04T18:17:31.589 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-06-04T18:17:31.760 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-06-04T18:17:31.760 INFO:teuthology.nuke:Checking targets against current locks 2021-06-04T18:17:31.844 INFO:teuthology.nuke:Not nuking smithi084.front.sepia.ceph.com because description doesn't match 2021-06-04T18:17:31.844 INFO:teuthology.nuke:Not nuking smithi110.front.sepia.ceph.com because description doesn't match 2021-06-04T18:17:31.860 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-04T18:17:31.909 INFO:teuthology.orchestra.console:Power off smithi199 2021-06-04T18:17:32.051 INFO:teuthology.orchestra.console:Power off for smithi199 completed 2021-06-04T18:17:32.194 INFO:teuthology.lock.ops:unlocked smithi199.front.sepia.ceph.com