2023-12-05T15:27:37.076 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-05T15:27:37.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:27:37.197 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f539af62ee0>, signals=[15]) 2023-12-05T15:27:37.197 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-12-05T15:27:37.198 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T15:27:37.198 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-12-05T15:27:37.220 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-12-05T15:27:37.221 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T15:27:37.221 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-12-05T15:27:37.337 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_8.stream (ID 3) 2023-12-05T15:27:37.355 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-12-05T15:27:37.375 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream 2023-12-05T15:27:37.398 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-12-05T15:27:37.614 INFO:teuthology.orchestra.console.smithi203:Power off 2023-12-05T15:27:37.614 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T15:27:37.625 INFO:teuthology.orchestra.console.smithi040:Power off 2023-12-05T15:27:37.626 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T15:27:37.634 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-12-05T15:27:37.635 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:37.646 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-12-05T15:27:37.647 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:37.654 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-05T15:27:37.670 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-12-05T15:27:41.659 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:41.670 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:41.768 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-05T15:27:41.778 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-12-05T15:27:45.773 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:45.780 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:45.882 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-05T15:27:45.887 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-12-05T15:27:45.988 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-12-05T15:27:46.088 INFO:teuthology.orchestra.console.smithi040:Power on 2023-12-05T15:27:46.089 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T15:27:46.108 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2023-12-05T15:27:46.108 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:46.126 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-12-05T15:27:49.886 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:49.994 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-05T15:27:50.095 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-12-05T15:27:50.127 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:50.196 INFO:teuthology.orchestra.console.smithi203:Power on 2023-12-05T15:27:50.196 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T15:27:50.216 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-12-05T15:27:50.216 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:50.235 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-12-05T15:27:50.236 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-05T15:27:54.238 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:54.244 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T15:27:54.347 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-12-05T15:27:54.351 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-05T15:27:54.448 INFO:teuthology.orchestra.console.smithi040:Power on completed 2023-12-05T15:27:54.452 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-12-05T15:27:54.549 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-12-05T15:27:54.553 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-12-05T15:30:57.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:31:00.706 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-12-05T15:31:06.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:31:09.794 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-12-05T15:31:15.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:31:18.850 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-12-05T15:31:24.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:31:27.940 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-12-05T15:31:33.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:31:37.026 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-12-05T15:31:43.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:31:46.118 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-12-05T15:31:52.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:32:52.130 WARNING:teuthology.provision.fog.smithi040:timed out 2023-12-05T15:32:58.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:32:58.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T15:32:58.416 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T15:32:58.647 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-12-05T15:32:58.647 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-12-05T15:32:58.667 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-12-05T15:32:58.667 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-12-05T15:32:58.727 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-12-05T15:32:58.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-12-05T15:32:58.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-12-05T15:32:58.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-12-05T15:32:58.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-12-05T15:32:59.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-12-05T15:32:59.071 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T15:32:59.130 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T15:32:59.131 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T15:32:59.131 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-12-05T15:32:59.132 DEBUG:teuthology.parallel:result is None 2023-12-05T15:32:59.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:33:02.242 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:33:08.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:33:11.302 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:33:17.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:33:20.386 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:33:26.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:33:29.474 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:33:35.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:33:38.530 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:33:44.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:33:47.590 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:33:53.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:33:56.678 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:34:02.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:34:05.766 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-05T15:34:11.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:35:11.831 WARNING:teuthology.provision.fog.smithi203:timed out 2023-12-05T15:35:17.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:35:18.109 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T15:35:18.109 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T15:35:18.366 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-12-05T15:35:18.367 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-12-05T15:35:18.386 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-12-05T15:35:18.386 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-12-05T15:35:18.445 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-12-05T15:35:18.445 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-12-05T15:35:18.556 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-12-05T15:35:18.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-12-05T15:35:18.656 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-12-05T15:35:18.724 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-12-05T15:35:18.792 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T15:35:18.850 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-12-05T15:35:18.851 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T15:35:18.851 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-12-05T15:35:18.851 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T15:35:18.851 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T15:35:18.851 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T15:35:18.851 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-12-05T15:35:18.852 DEBUG:teuthology.parallel:result is None 2023-12-05T15:35:19.004 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-12-05T15:35:19.004 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T15:35:19.024 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-12-05T15:35:19.024 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T15:35:19.050 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-12-05T15:35:19.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-05T15:35:19.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:35:19.123 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-12-05T15:35:19.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-05T15:35:19.267 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-12-05T15:35:19.328 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-12-05T15:35:19.328 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-12-05T15:35:19.388 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-12-05T15:35:19.388 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T15:35:19.389 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T15:35:19.390 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-12-05T15:35:19.424 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-12-05T15:35:19.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-05T15:35:19.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T15:35:19.494 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-12-05T15:35:19.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-05T15:35:19.561 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-12-05T15:35:19.619 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-12-05T15:35:19.620 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-12-05T15:35:19.679 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-12-05T15:35:19.679 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-12-05T15:35:19.679 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-12-05T15:35:19.679 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-12-05T15:35:19.679 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-12-05T15:35:19.679 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-12-05T15:35:19.680 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T15:35:19.680 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-12-05T15:35:19.680 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T15:35:19.680 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-12-05T15:35:19.680 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T15:35:19.680 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T15:35:19.680 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T15:35:19.680 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-12-05T15:35:19.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:35:19.786 INFO:teuthology.dispatcher.supervisor:Running job 7477884 2023-12-05T15:35:19.786 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-12-05_15:27:23-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477884 --name gabrioux-2023-12-05_15:27:23-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2023-12-05_15:27:23-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477884/orig.config.yaml 2023-12-05T15:35:19.789 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-12-05_15:27:23-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477884 2023-12-05T15:35:19.789 INFO:teuthology.dispatcher.supervisor:Job PID: 835980 2023-12-05T15:35:19.789 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-05T15:37:19.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:39:20.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:41:20.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:43:20.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:45:20.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:47:20.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:49:20.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:51:21.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:53:21.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:55:21.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:57:21.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T15:59:21.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:01:21.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:03:21.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:05:22.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:07:22.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:09:22.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:11:22.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:13:22.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:15:23.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:17:23.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:19:23.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:21:23.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:23:23.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:25:23.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:27:23.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:29:24.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:31:24.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:33:24.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:35:24.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:37:24.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T16:37:24.802 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-05T16:37:24.895 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-05T16:37:24.895 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T16:37:24.942 DEBUG:teuthology.nuke:shortname: smithi040 2023-12-05T16:37:24.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T16:37:24.965 DEBUG:teuthology.nuke:shortname: smithi203 2023-12-05T16:37:24.965 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T16:37:24.969 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-05_15:27:23-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 15:27:36.294801', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2qGnSIkMUEVE3aOrbPU0xjtiw1p8iYqCalbkU18vXFJxNTT6IN26Z7AoxMg7NJIr73alzk52LoPqj4r6ezaEc='} 2023-12-05T16:37:24.988 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-05_15:27:23-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 15:27:36.293387', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHCdHpwSObwIWSW+bYWIcvSZLFBFAOr5e+4jqyhIWbo4RwpPPoC4B0PI4XbX9Kib48V72GX6qg/ZFKR6oD0RCzE='} 2023-12-05T16:37:25.018 INFO:teuthology.orchestra.console.smithi040:Power off 2023-12-05T16:37:25.019 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T16:37:25.037 INFO:teuthology.orchestra.console.smithi203:Power off 2023-12-05T16:37:25.037 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T16:37:25.046 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-12-05T16:37:25.047 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T16:37:25.058 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-12-05T16:37:25.059 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T16:37:25.070 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-12-05T16:37:25.079 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-05T16:37:25.171 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-12-05T16:37:25.180 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-12-05T16:37:25.316 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-12-05T16:37:25.324 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com