2024-04-08T17:14:05.760 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-08T17:14:05.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:14:05.945 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5ed4ae9c10>, signals=[15]) 2024-04-08T17:14:05.945 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2024-04-08T17:14:05.946 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T17:14:05.946 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-08T17:14:05.966 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2024-04-08T17:14:05.966 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T17:14:05.966 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-08T17:14:05.990 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2024-04-08T17:14:05.991 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T17:14:05.991 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-08T17:14:06.112 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T17:14:06.123 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T17:14:06.127 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T17:14:06.165 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 8.stream 2024-04-08T17:14:06.167 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream 2024-04-08T17:14:06.176 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 8.stream 2024-04-08T17:14:06.447 INFO:teuthology.orchestra.console.smithi104:Power off 2024-04-08T17:14:06.447 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T17:14:06.461 INFO:teuthology.orchestra.console.smithi038:Power off 2024-04-08T17:14:06.461 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T17:14:06.475 INFO:teuthology.orchestra.console.smithi066:Power off 2024-04-08T17:14:06.475 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T17:14:06.518 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-04-08T17:14:06.518 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:06.526 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-04-08T17:14:06.526 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:06.533 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-04-08T17:14:06.534 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:06.541 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-08T17:14:06.552 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-08T17:14:06.556 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-08T17:14:10.542 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:10.553 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:10.560 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:10.651 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-08T17:14:10.661 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-08T17:14:10.668 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-08T17:14:14.654 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:14.662 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:14.668 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:14.764 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-08T17:14:14.771 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-08T17:14:14.777 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-08T17:14:14.865 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-04-08T17:14:14.878 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-04-08T17:14:14.966 INFO:teuthology.orchestra.console.smithi104:Power on 2024-04-08T17:14:14.966 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T17:14:14.979 INFO:teuthology.orchestra.console.smithi066:Power on 2024-04-08T17:14:14.979 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T17:14:14.988 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2024-04-08T17:14:14.988 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:15.000 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2024-04-08T17:14:15.000 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:15.008 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-08T17:14:15.021 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-08T17:14:18.777 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:18.886 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-08T17:14:18.987 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-04-08T17:14:19.009 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:19.021 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:19.088 INFO:teuthology.orchestra.console.smithi038:Power on 2024-04-08T17:14:19.088 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T17:14:19.110 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2024-04-08T17:14:19.110 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:19.118 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-08T17:14:19.129 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-08T17:14:19.130 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-08T17:14:23.122 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:23.131 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:23.137 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:23.231 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-08T17:14:23.239 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-08T17:14:23.245 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-08T17:14:23.332 INFO:teuthology.orchestra.console.smithi104:Power on completed 2024-04-08T17:14:23.339 INFO:teuthology.orchestra.console.smithi066:Power on completed 2024-04-08T17:14:23.433 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2024-04-08T17:14:23.440 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2024-04-08T17:14:27.249 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T17:14:27.357 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-08T17:14:27.458 INFO:teuthology.orchestra.console.smithi038:Power on completed 2024-04-08T17:14:27.559 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2024-04-08T17:16:58.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:09.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:12.254 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-08T17:17:18.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:21.310 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-08T17:17:24.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:27.294 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:17:27.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:30.366 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-08T17:17:33.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:36.351 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:17:36.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:39.426 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-08T17:17:42.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:45.410 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:17:45.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:48.510 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-08T17:17:51.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:54.462 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:17:54.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:17:57.566 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-08T17:17:58.361 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-04-08T17:18:00.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:18:03.518 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:18:03.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:18:09.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:18:12.574 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:18:18.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:18:21.630 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:18:27.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:18:30.686 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:18:36.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:18:39.742 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-08T17:18:45.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:18:49.631 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-08T17:19:02.373 WARNING:teuthology.provision.fog.smithi038:timed out 2024-04-08T17:19:03.570 WARNING:teuthology.provision.fog.smithi104:timed out 2024-04-08T17:19:08.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:19:08.624 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T17:19:08.624 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T17:19:08.859 INFO:teuthology.provision.fog.smithi038:Node is ready 2024-04-08T17:19:08.859 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2024-04-08T17:19:08.878 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2024-04-08T17:19:08.878 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2024-04-08T17:19:08.937 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2024-04-08T17:19:08.937 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-04-08T17:19:09.039 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2024-04-08T17:19:09.068 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2024-04-08T17:19:09.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2024-04-08T17:19:09.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-04-08T17:19:09.274 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-08T17:19:09.332 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T17:19:09.333 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T17:19:09.334 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2024-04-08T17:19:09.335 DEBUG:teuthology.parallel:result is None 2024-04-08T17:19:09.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:19:09.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T17:19:09.847 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T17:19:10.101 INFO:teuthology.provision.fog.smithi104:Node is ready 2024-04-08T17:19:10.102 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2024-04-08T17:19:10.121 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2024-04-08T17:19:10.121 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2024-04-08T17:19:10.180 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2024-04-08T17:19:10.180 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2024-04-08T17:19:10.293 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2024-04-08T17:19:10.323 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2024-04-08T17:19:10.392 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2024-04-08T17:19:10.461 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2024-04-08T17:19:10.527 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-08T17:19:10.585 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-08T17:19:10.585 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2024-04-08T17:19:10.585 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-08T17:19:10.585 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-08T17:19:10.585 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T17:19:10.586 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T17:19:10.586 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2024-04-08T17:19:10.587 DEBUG:teuthology.parallel:result is None 2024-04-08T17:19:17.511 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T17:19:17.512 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T17:19:42.948 INFO:teuthology.provision.fog.smithi066:Node is ready 2024-04-08T17:19:42.948 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2024-04-08T17:19:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2024-04-08T17:19:42.973 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2024-04-08T17:19:43.034 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2024-04-08T17:19:43.034 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-08T17:19:43.159 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2024-04-08T17:19:43.191 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2024-04-08T17:19:43.262 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2024-04-08T17:19:43.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-08T17:19:43.403 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-08T17:19:43.462 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-08T17:19:43.462 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8" 2024-04-08T17:19:43.462 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-08T17:19:43.462 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-08T17:19:43.462 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8" 2024-04-08T17:19:43.462 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2024-04-08T17:19:43.462 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T17:19:43.463 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-08T17:19:43.463 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T17:19:43.463 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-08T17:19:43.463 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T17:19:43.463 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T17:19:43.463 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T17:19:43.463 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2024-04-08T17:19:43.464 DEBUG:teuthology.parallel:result is None 2024-04-08T17:19:43.665 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2024-04-08T17:19:43.665 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T17:19:43.688 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2024-04-08T17:19:43.688 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T17:19:43.704 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2024-04-08T17:19:43.705 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T17:19:43.722 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2024-04-08T17:19:43.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-08T17:19:43.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:19:43.798 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-04-08T17:19:43.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-08T17:19:43.873 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-04-08T17:19:43.935 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-04-08T17:19:43.935 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-04-08T17:19:43.996 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T17:19:43.997 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-04-08T17:19:43.997 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T17:19:43.997 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T17:19:43.997 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T17:19:43.997 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-08T17:19:44.022 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2024-04-08T17:19:44.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-08T17:19:44.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:19:44.094 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-04-08T17:19:44.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-08T17:19:44.167 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-04-08T17:19:44.227 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-04-08T17:19:44.227 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-08T17:19:44.287 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-08T17:19:44.287 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8" 2024-04-08T17:19:44.287 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-08T17:19:44.287 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T17:19:44.288 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T17:19:44.288 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-08T17:19:45.680 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2024-04-08T17:19:45.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-08T17:19:45.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T17:19:45.755 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-08T17:19:45.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-08T17:19:45.847 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-08T17:19:45.906 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-08T17:19:45.906 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T17:19:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T17:19:45.966 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-08T17:19:45.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:19:46.088 INFO:teuthology.dispatcher.supervisor:Running job 7645021 2024-04-08T17:19:46.088 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-08_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7645021 --name teuthology-2024-04-08_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-parallel/{point-to-point-upgrade supported-all-distro/centos_8} -- /home/teuthworker/archive/teuthology-2024-04-08_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7645021/orig.config.yaml 2024-04-08T17:19:46.092 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-08_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7645021 2024-04-08T17:19:46.092 INFO:teuthology.dispatcher.supervisor:Job PID: 1384248 2024-04-08T17:19:46.092 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-08T17:21:46.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:23:46.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:25:46.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:27:46.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:29:46.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:31:46.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:33:47.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:35:47.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:37:47.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:39:47.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:41:47.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:43:48.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:45:48.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:47:48.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:49:48.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:51:48.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:53:48.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:55:49.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:57:49.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T17:59:49.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:01:49.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:03:49.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:05:50.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:07:50.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:09:50.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:11:50.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:13:50.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:15:50.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:17:51.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:19:51.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:21:51.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:23:51.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:25:51.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:27:51.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:29:52.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:31:52.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:33:52.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T18:33:52.423 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1