2023-10-21T12:51:57.254 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T12:51:57.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T12:51:57.421 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa58460b670>, signals=[15]) 2023-10-21T12:51:57.423 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2023-10-21T12:51:57.423 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T12:51:57.424 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-21T12:51:57.449 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-10-21T12:51:57.449 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T12:51:57.450 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-21T12:51:57.451 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"} 2023-10-21T12:51:57.474 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-10-21T12:51:57.531 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T12:51:57.548 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T12:51:57.580 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T12:51:57.581 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 3} 2023-10-21T12:51:57.589 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T12:51:57.590 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 3} 2023-10-21T12:51:57.630 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 8.stream 2023-10-21T12:51:57.631 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:51:57.635 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2023-10-21T12:51:57.635 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:51:57.708 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T12:51:57.712 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T12:51:57.755 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1} 2023-10-21T12:51:57.758 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-10-21T12:51:57.818 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:51:57.822 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:51:57.933 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-21T12:51:57.934 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T12:51:57.946 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-21T12:51:57.947 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T12:51:57.955 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-21T12:51:57.956 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:51:57.968 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-21T12:51:57.969 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:51:57.981 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-21T12:51:57.989 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-21T12:51:58.082 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-21T12:51:58.091 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-21T12:51:58.183 INFO:teuthology.orchestra.console.smithi094:Power on 2023-10-21T12:51:58.184 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T12:51:58.193 INFO:teuthology.orchestra.console.smithi105:Power on 2023-10-21T12:51:58.193 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T12:51:58.207 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2023-10-21T12:51:58.208 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:51:58.216 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2023-10-21T12:51:58.217 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:51:58.229 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-21T12:51:58.238 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-21T12:52:02.234 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:52:02.241 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:52:02.344 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-21T12:52:02.349 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-21T12:52:02.446 INFO:teuthology.orchestra.console.smithi094:Power on completed 2023-10-21T12:52:02.547 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2023-10-21T12:52:02.547 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:52:06.351 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:52:06.460 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-21T12:52:06.561 INFO:teuthology.orchestra.console.smithi105:Power on completed 2023-10-21T12:52:06.662 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-10-21T12:52:06.663 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:52:17.646 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:52:21.759 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:52:32.742 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:52:36.842 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:52:47.846 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:52:51.934 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:53:02.938 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:53:07.035 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:53:18.022 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:53:22.122 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:53:33.102 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:53:37.222 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:53:48.190 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:53:52.298 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:54:03.274 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:54:07.370 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:54:18.362 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:54:22.442 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:54:33.450 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:54:37.518 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-21T12:54:37.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:54:48.520 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T12:54:48.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:55:07.130 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T12:55:13.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:55:16.186 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T12:55:22.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:55:25.245 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T12:55:31.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:55:34.298 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T12:55:38.254 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 427, in connect server_key = t.get_remote_server_key() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 879, in get_remote_server_key raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2023-10-21T12:55:40.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:56:33.147 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-21T12:56:40.309 WARNING:teuthology.provision.fog.smithi094:timed out 2023-10-21T12:56:42.260 WARNING:teuthology.provision.fog.smithi105:timed out 2023-10-21T12:56:46.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:56:46.521 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T12:56:46.522 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T12:56:46.777 INFO:teuthology.provision.fog.smithi094:Node is ready 2023-10-21T12:56:46.778 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2023-10-21T12:56:46.797 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2023-10-21T12:56:46.797 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2023-10-21T12:56:46.857 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2023-10-21T12:56:46.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-21T12:56:46.961 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2023-10-21T12:56:46.991 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2023-10-21T12:56:47.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2023-10-21T12:56:47.129 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-21T12:56:47.197 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-21T12:56:47.254 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-21T12:56:47.255 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-10-21T12:56:47.255 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-21T12:56:47.255 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:56:47.255 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-10-21T12:56:47.255 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:56:47.256 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:56:47.256 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-21T12:56:47.256 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:56:47.256 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:56:47.256 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:56:47.257 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:56:47.257 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:56:47.258 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2023-10-21T12:56:47.259 DEBUG:teuthology.parallel:result is None 2023-10-21T12:56:48.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:56:48.515 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T12:56:48.516 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T12:56:48.766 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-10-21T12:56:48.767 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-10-21T12:56:48.786 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-10-21T12:56:48.786 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-10-21T12:56:48.846 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-10-21T12:56:48.846 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-10-21T12:56:48.951 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-10-21T12:56:48.983 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-10-21T12:56:49.052 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-10-21T12:56:49.122 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-10-21T12:56:49.191 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-21T12:56:49.249 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-10-21T12:56:49.249 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-10-21T12:56:49.249 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-10-21T12:56:49.249 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:56:49.250 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-10-21T12:56:49.250 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:56:49.250 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:56:49.250 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-10-21T12:56:49.250 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:56:49.251 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:56:49.251 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:56:49.251 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:56:49.251 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:56:49.252 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-10-21T12:56:49.252 DEBUG:teuthology.parallel:result is None 2023-10-21T12:56:49.414 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2023-10-21T12:56:49.415 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T12:56:49.448 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-10-21T12:56:49.448 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T12:56:49.466 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2023-10-21T12:56:49.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-21T12:56:49.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:56:49.533 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-21T12:56:49.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-21T12:56:49.604 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-10-21T12:56:49.664 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-10-21T12:56:49.665 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-21T12:56:49.725 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-21T12:56:49.726 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-10-21T12:56:49.726 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-21T12:56:49.726 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:56:49.726 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-10-21T12:56:49.727 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:56:49.727 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:56:49.727 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-21T12:56:49.727 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:56:49.727 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:56:49.728 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:56:49.728 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:56:49.728 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:56:49.729 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-21T12:56:49.749 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-10-21T12:56:49.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-21T12:56:49.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:56:49.817 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-21T12:56:49.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-21T12:56:49.889 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-10-21T12:56:49.947 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-10-21T12:56:49.947 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-21T12:56:50.005 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-10-21T12:56:50.005 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-10-21T12:56:50.006 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-10-21T12:56:50.006 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:56:50.006 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-10-21T12:56:50.006 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:56:50.006 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:56:50.007 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-10-21T12:56:50.007 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:56:50.007 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:56:50.007 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:56:50.007 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:56:50.008 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:56:50.008 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-21T12:56:50.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T12:56:50.110 INFO:teuthology.dispatcher.supervisor:Running job 7434185 2023-10-21T12:56:50.110 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434185 --name yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi --description orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434185/orig.config.yaml 2023-10-21T12:56:50.114 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434185 2023-10-21T12:56:50.114 INFO:teuthology.dispatcher.supervisor:Job PID: 1310691 2023-10-21T12:56:50.115 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T12:58:50.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:00:50.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:02:50.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:04:50.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:06:50.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:08:51.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:10:51.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:12:51.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:14:51.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:16:51.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:18:51.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:20:51.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:22:52.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:24:52.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:26:52.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:28:52.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:30:52.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:32:52.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:34:53.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:36:53.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:38:53.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:40:53.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:42:53.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T13:42:53.849 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T13:42:54.052 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T13:42:54.053 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T13:42:54.100 DEBUG:teuthology.nuke:shortname: smithi094 2023-10-21T13:42:54.101 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T13:42:54.115 DEBUG:teuthology.nuke:shortname: smithi105 2023-10-21T13:42:54.115 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T13:42:54.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434185', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 12:51:56.428087', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHrt0y4OJJSfwJYXQUjgJsLyA+chsQwJtNAKT3J3zAgET6qX6ikj2G0Qpn9K9nEmNb3E+ikxuAHg9gIURZkg5b4='} 2023-10-21T13:42:54.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434185', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 12:51:56.429954', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/FQIKXzeRvUBJdTfd3EYx8e0ijvxevYXMtlqmXKcYG2nrPdshGYMXKWCLTTIc3/5rdnvZA8dqmSmMhj1YZ4Rc='} 2023-10-21T13:42:54.167 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-21T13:42:54.168 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T13:42:54.180 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-21T13:42:54.180 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T13:42:54.189 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-21T13:42:54.189 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T13:42:54.201 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-21T13:42:54.202 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T13:42:54.210 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-21T13:42:54.223 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-21T13:42:54.312 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-21T13:42:54.325 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-21T13:42:54.456 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com 2023-10-21T13:42:54.473 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com