2023-11-29T17:55:04.923 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-11-29T17:55:04.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T17:55:05.066 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa119fd7550>, signals=[15]) 2023-11-29T17:55:05.066 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-11-29T17:55:05.067 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T17:55:05.067 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-29T17:55:05.091 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2023-11-29T17:55:05.091 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T17:55:05.092 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-11-29T17:55:05.205 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10) 2023-11-29T17:55:05.227 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_9.stream (ID 10) 2023-11-29T17:55:05.246 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream 2023-11-29T17:55:05.270 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 9.stream 2023-11-29T17:55:05.469 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-29T17:55:05.469 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T17:55:05.483 INFO:teuthology.orchestra.console.smithi131:Power off 2023-11-29T17:55:05.483 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T17:55:05.494 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-29T17:55:05.494 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:05.507 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-11-29T17:55:05.507 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:05.515 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-29T17:55:05.528 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-11-29T17:55:09.520 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:09.528 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:09.629 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-29T17:55:09.637 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-11-29T17:55:13.635 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:13.642 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:13.744 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-29T17:55:13.751 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-11-29T17:55:13.852 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-11-29T17:55:13.953 INFO:teuthology.orchestra.console.smithi131:Power on 2023-11-29T17:55:13.953 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T17:55:13.975 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2023-11-29T17:55:13.975 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:13.995 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-11-29T17:55:17.748 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:17.864 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-29T17:55:17.965 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-29T17:55:17.997 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:18.066 INFO:teuthology.orchestra.console.smithi033:Power on 2023-11-29T17:55:18.066 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T17:55:18.088 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-11-29T17:55:18.088 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:18.106 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-11-29T17:55:18.109 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-29T17:55:22.110 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:22.119 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:22.221 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-11-29T17:55:22.227 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-29T17:55:22.323 INFO:teuthology.orchestra.console.smithi131:Power on completed 2023-11-29T17:55:22.423 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2023-11-29T17:55:26.232 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T17:55:26.340 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-29T17:55:26.440 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-11-29T17:55:26.541 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-11-29T17:57:53.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:57:56.226 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T17:57:57.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:00.258 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-29T17:58:02.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:05.283 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T17:58:06.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:09.314 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-29T17:58:11.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:14.338 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T17:58:15.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:18.370 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-29T17:58:20.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:23.394 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T17:58:24.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:27.430 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-29T17:58:29.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:32.450 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T17:58:33.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:38.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:41.506 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T17:58:47.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:58:50.594 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T17:58:56.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:59:33.470 WARNING:teuthology.provision.fog.smithi033:timed out 2023-11-29T17:59:39.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T17:59:39.716 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T17:59:39.716 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T17:59:40.080 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-11-29T17:59:40.081 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-11-29T17:59:40.096 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-11-29T17:59:40.096 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-11-29T17:59:40.152 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-11-29T17:59:40.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-29T17:59:40.276 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-11-29T17:59:40.307 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-11-29T17:59:40.380 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-11-29T17:59:40.451 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-29T17:59:40.521 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-29T17:59:40.576 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-11-29T17:59:40.576 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-11-29T17:59:40.576 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-11-29T17:59:40.576 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-11-29T17:59:40.576 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-29T17:59:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-29T17:59:40.578 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-11-29T17:59:40.579 DEBUG:teuthology.parallel:result is None 2023-11-29T17:59:56.612 WARNING:teuthology.provision.fog.smithi131:timed out 2023-11-29T18:00:02.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T18:00:02.896 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T18:00:02.897 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T18:00:03.212 INFO:teuthology.provision.fog.smithi131:Node is ready 2023-11-29T18:00:03.212 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2023-11-29T18:00:03.226 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2023-11-29T18:00:03.226 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2023-11-29T18:00:03.278 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2023-11-29T18:00:03.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-11-29T18:00:03.374 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2023-11-29T18:00:03.402 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2023-11-29T18:00:03.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2023-11-29T18:00:03.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-11-29T18:00:03.600 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-11-29T18:00:03.654 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-11-29T18:00:03.654 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T18:00:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-29T18:00:03.656 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-29T18:00:03.656 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2023-11-29T18:00:03.656 DEBUG:teuthology.parallel:result is None 2023-11-29T18:00:03.831 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-11-29T18:00:03.832 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T18:00:03.855 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2023-11-29T18:00:03.855 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T18:00:03.880 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-11-29T18:00:03.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-29T18:00:03.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T18:00:03.976 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-11-29T18:00:04.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-29T18:00:04.157 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-11-29T18:00:04.211 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-11-29T18:00:04.212 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-29T18:00:04.266 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T18:00:04.267 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-29T18:00:04.268 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-29T18:00:04.268 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-29T18:00:04.296 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2023-11-29T18:00:04.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-11-29T18:00:04.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T18:00:04.378 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-11-29T18:00:04.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-11-29T18:00:04.444 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-11-29T18:00:04.497 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-11-29T18:00:04.497 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2023-11-29T18:00:04.551 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-29T18:00:04.552 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-11-29T18:00:04.552 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T18:00:04.552 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-29T18:00:04.552 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-29T18:00:04.552 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-11-29T18:00:04.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:00:04.672 INFO:teuthology.dispatcher.supervisor:Running job 7471118 2023-11-29T18:00:04.672 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-11-29_17:50:42-fs:shell-main-distro-default-smithi/7471118 --name pdonnell-2023-11-29_17:50:42-fs:shell-main-distro-default-smithi --description fs:shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/centos_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} -- /home/teuthworker/archive/pdonnell-2023-11-29_17:50:42-fs:shell-main-distro-default-smithi/7471118/orig.config.yaml 2023-11-29T18:00:04.675 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-11-29_17:50:42-fs:shell-main-distro-default-smithi/7471118 2023-11-29T18:00:04.675 INFO:teuthology.dispatcher.supervisor:Job PID: 1929975 2023-11-29T18:00:04.675 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-29T18:02:04.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:04:04.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:06:05.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:08:05.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:10:05.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:12:05.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:14:05.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:16:06.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:18:06.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:20:06.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:22:06.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:24:06.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:26:06.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:28:07.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:30:07.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:32:07.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:34:07.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:36:07.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:38:07.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:40:08.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T18:40:08.105 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-29T18:40:08.271 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-29T18:40:08.271 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T18:40:08.322 DEBUG:teuthology.nuke:shortname: smithi033 2023-11-29T18:40:08.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T18:40:08.342 DEBUG:teuthology.nuke:shortname: smithi131 2023-11-29T18:40:08.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T18:40:08.348 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-29_17:50:42-fs:shell-main-distro-default-smithi/7471118', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 17:55:04.056240', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPnbKO2hXJKn16jzUumGIOsOfHZ9Ns1O3lXcej5y6IJCidnEw4V58E/p0yClTi7rq6zykmjuds09+ZXfJvFDFHY='} 2023-11-29T18:40:08.368 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-29_17:50:42-fs:shell-main-distro-default-smithi/7471118', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 17:55:04.057509', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJhhFNDARRQadA8i8sP3OmiELHcjpNydtzTucjoMHYWFW4A87ytq6kd2lGiZRFkMnxq3xtJLcWyOoYu7jcUnFQg='} 2023-11-29T18:40:08.396 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-29T18:40:08.396 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T18:40:08.419 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-29T18:40:08.419 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T18:40:08.433 INFO:teuthology.orchestra.console.smithi131:Power off 2023-11-29T18:40:08.434 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T18:40:08.444 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-29T18:40:08.456 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-11-29T18:40:08.457 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T18:40:08.479 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-11-29T18:40:08.545 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-29T18:40:08.580 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-11-29T18:40:08.697 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-11-29T18:40:08.728 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com