2023-11-21T10:39:33.367 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-21T10:39:33.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:39:33.508 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b41c1c670>, signals=[15]) 2023-11-21T10:39:33.509 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-11-21T10:39:33.509 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-11-21T10:39:33.509 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-11-21T10:39:33.534 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-11-21T10:39:33.534 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-11-21T10:39:33.534 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-21T10:39:33.653 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_centos_9.stream (ID 10) 2023-11-21T10:39:33.671 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_9.stream (ID 10) 2023-11-21T10:39:33.694 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 9.stream 2023-11-21T10:39:33.719 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 9.stream 2023-11-21T10:39:33.939 INFO:teuthology.orchestra.console.smithi078:Power off 2023-11-21T10:39:33.939 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-21T10:39:33.961 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-11-21T10:39:33.962 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:33.976 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-21T10:39:33.976 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-21T10:39:33.984 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-11-21T10:39:33.996 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-21T10:39:33.996 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:34.016 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-21T10:39:37.986 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:38.017 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:38.096 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-11-21T10:39:38.125 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-21T10:39:42.098 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:42.126 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:42.206 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-11-21T10:39:42.235 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-21T10:39:46.210 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:46.236 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:46.319 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-11-21T10:39:46.344 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-21T10:39:46.420 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-11-21T10:39:46.444 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-21T10:39:46.521 INFO:teuthology.orchestra.console.smithi078:Power on 2023-11-21T10:39:46.521 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-21T10:39:46.541 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2023-11-21T10:39:46.542 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:46.551 INFO:teuthology.orchestra.console.smithi148:Power on 2023-11-21T10:39:46.551 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-21T10:39:46.564 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-11-21T10:39:46.570 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-11-21T10:39:46.571 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:46.590 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-21T10:39:50.566 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:50.592 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:50.678 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-11-21T10:39:50.700 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-21T10:39:54.682 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:54.701 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T10:39:54.791 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-11-21T10:39:54.808 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-21T10:39:54.892 INFO:teuthology.orchestra.console.smithi078:Power on completed 2023-11-21T10:39:54.909 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-11-21T10:39:54.993 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-11-21T10:39:55.010 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-11-21T10:42:40.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:42:40.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:42:59.298 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-21T10:42:59.302 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-21T10:43:05.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:05.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:08.390 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-21T10:43:08.390 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-21T10:43:14.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:14.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:17.474 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-21T10:43:17.474 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-21T10:43:23.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:23.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:26.530 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-21T10:43:33.751 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-21T10:43:39.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:39.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:43:58.178 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-21T10:44:04.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:44:07.266 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-21T10:44:13.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:44:13.919 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-21T10:44:13.919 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-21T10:44:34.319 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-11-21T10:44:34.319 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-11-21T10:44:34.377 INFO:teuthology.orchestra.run.smithi078.stdout:smithi046 2023-11-21T10:44:34.378 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi046 /etc/hosts 2023-11-21T10:44:34.435 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-21T10:44:34.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-11-21T10:44:34.620 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi046/smithi078/g' /etc/hosts 2023-11-21T10:44:34.651 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.46/172.21.15.78/g' /etc/hosts 2023-11-21T10:44:34.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi046/smithi078/g' /etc/hostname 2023-11-21T10:44:34.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-11-21T10:44:34.858 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-11-21T10:44:34.914 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2023-11-21T10:44:34.915 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-21T10:44:34.915 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2023-11-21T10:44:34.915 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-21T10:44:34.915 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-21T10:44:34.915 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-21T10:44:34.916 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-11-21T10:44:34.918 DEBUG:teuthology.parallel:result is None 2023-11-21T10:44:39.762 WARNING:teuthology.provision.fog.smithi148:timed out 2023-11-21T10:44:45.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:44:46.032 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-21T10:44:46.032 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-21T10:44:46.377 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-11-21T10:44:46.377 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-11-21T10:44:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-11-21T10:44:46.393 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-11-21T10:44:46.448 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-11-21T10:44:46.449 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-21T10:44:46.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-11-21T10:44:46.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-11-21T10:44:46.657 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-11-21T10:44:46.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-21T10:44:46.791 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-21T10:44:46.846 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-11-21T10:44:46.846 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-21T10:44:46.847 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-21T10:44:46.848 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-11-21T10:44:46.848 DEBUG:teuthology.parallel:result is None 2023-11-21T10:44:47.013 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-11-21T10:44:47.014 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-21T10:44:47.042 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-11-21T10:44:47.042 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-21T10:44:47.068 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-11-21T10:44:47.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-21T10:44:47.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:44:47.151 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-11-21T10:44:47.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-21T10:44:47.329 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-11-21T10:44:47.385 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-11-21T10:44:47.385 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-11-21T10:44:47.440 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2023-11-21T10:44:47.440 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2023-11-21T10:44:47.440 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2023-11-21T10:44:47.440 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2023-11-21T10:44:47.440 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2023-11-21T10:44:47.440 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2023-11-21T10:44:47.440 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-21T10:44:47.441 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-11-21T10:44:47.441 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2023-11-21T10:44:47.441 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-21T10:44:47.441 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2023-11-21T10:44:47.441 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-21T10:44:47.441 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-21T10:44:47.441 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-21T10:44:47.441 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-11-21T10:44:47.467 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-11-21T10:44:47.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-21T10:44:47.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-21T10:44:47.551 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-11-21T10:44:47.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-21T10:44:47.620 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-11-21T10:44:47.675 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-11-21T10:44:47.676 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-21T10:44:47.730 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-21T10:44:47.731 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-11-21T10:44:47.732 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-21T10:44:47.732 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-21T10:44:47.732 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-21T10:44:47.732 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-21T10:44:47.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:44:47.844 INFO:teuthology.dispatcher.supervisor:Running job 7463764 2023-11-21T10:44:47.844 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_vallariag@teuthology --archive /home/teuthworker/archive/vallariag-2023-11-21_10:35:32-rbd:nvmeof-main-distro-default-smithi/7463764 --name vallariag-2023-11-21_10:35:32-rbd:nvmeof-main-distro-default-smithi --description rbd:nvmeof/{base/install centos_latest cluster/{fixed-3 openstack} workloads/nvmeof_initiator} -- /home/teuthworker/archive/vallariag-2023-11-21_10:35:32-rbd:nvmeof-main-distro-default-smithi/7463764/orig.config.yaml 2023-11-21T10:44:47.846 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vallariag-2023-11-21_10:35:32-rbd:nvmeof-main-distro-default-smithi/7463764 2023-11-21T10:44:47.847 INFO:teuthology.dispatcher.supervisor:Job PID: 3085101 2023-11-21T10:44:47.847 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-21T10:46:47.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:48:48.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:50:48.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:52:48.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:54:48.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:56:48.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T10:58:48.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T11:00:49.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-21T11:00:49.195 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-21T11:00:49.284 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-21T11:00:49.284 INFO:teuthology.nuke:Checking targets against current locks 2023-11-21T11:00:49.334 DEBUG:teuthology.nuke:shortname: smithi078 2023-11-21T11:00:49.334 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-21T11:00:49.349 DEBUG:teuthology.nuke:shortname: smithi148 2023-11-21T11:00:49.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-21T11:00:49.352 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2023-11-21_10:35:32-rbd:nvmeof-main-distro-default-smithi/7463764', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-21 10:39:32.607660', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAiYvc6l1MfsUEhWNGartINJqL+eWmqxhtyQN4VbGd9xVXvWyVleGM2qfMMqTSXTG4f54k8fFiYHYnbYA3TRjXA='} 2023-11-21T11:00:49.376 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2023-11-21_10:35:32-rbd:nvmeof-main-distro-default-smithi/7463764', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-21 10:39:32.609475', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFiale98tWZQzHRTylRlMuTrOH6tpRwCCWWwsP+p45YjcyM36oJGOuTSyJSsFwK7NUi3y1UdtKm8PR0YnJ152Y='} 2023-11-21T11:00:49.406 INFO:teuthology.orchestra.console.smithi078:Power off 2023-11-21T11:00:49.407 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-21T11:00:49.428 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-11-21T11:00:49.428 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T11:00:49.441 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-21T11:00:49.442 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-21T11:00:49.449 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-11-21T11:00:49.463 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-21T11:00:49.463 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-21T11:00:49.483 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-21T11:00:49.550 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-11-21T11:00:49.584 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-21T11:00:49.699 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-11-21T11:00:49.733 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com