2023-11-15T04:48:24.229 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T04:48:24.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:48:24.398 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e6f216ee0>, signals=[15]) 2023-11-15T04:48:24.399 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-11-15T04:48:24.400 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T04:48:24.400 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-15T04:48:24.425 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-11-15T04:48:24.426 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T04:48:24.426 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-11-15T04:48:24.428 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-11-15T04:48:24.450 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-11-15T04:48:24.496 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-15T04:48:24.524 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-15T04:48:24.544 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-15T04:48:24.544 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 2} 2023-11-15T04:48:24.569 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-15T04:48:24.569 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 2} 2023-11-15T04:48:24.608 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of ubuntu 20.04 2023-11-15T04:48:24.608 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:48:24.620 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04 2023-11-15T04:48:24.620 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:48:24.659 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T04:48:24.671 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T04:48:24.702 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-11-15T04:48:24.709 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-11-15T04:48:24.750 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:48:24.773 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:48:24.843 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-15T04:48:24.845 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T04:48:24.874 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-15T04:48:24.875 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:24.891 INFO:teuthology.orchestra.console.smithi133:Power off 2023-11-15T04:48:24.892 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T04:48:24.906 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-15T04:48:24.918 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-11-15T04:48:24.918 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:24.947 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-15T04:48:28.913 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:28.948 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:29.024 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-15T04:48:29.061 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-15T04:48:33.026 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:33.061 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:33.138 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-15T04:48:33.174 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-15T04:48:37.144 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:37.175 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:37.254 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-15T04:48:37.286 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-15T04:48:37.355 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-15T04:48:37.387 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-11-15T04:48:37.456 INFO:teuthology.orchestra.console.smithi112:Power on 2023-11-15T04:48:37.457 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T04:48:37.481 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-11-15T04:48:37.482 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:37.491 INFO:teuthology.orchestra.console.smithi133:Power on 2023-11-15T04:48:37.491 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T04:48:37.505 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-15T04:48:37.511 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-11-15T04:48:37.512 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:37.538 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-15T04:48:41.510 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:41.539 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:41.620 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-15T04:48:41.650 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-15T04:48:45.622 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:45.651 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:48:45.734 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-15T04:48:45.761 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-15T04:48:45.835 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-11-15T04:48:45.863 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-11-15T04:48:45.937 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-11-15T04:48:45.937 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:48:45.964 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-11-15T04:48:45.964 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:49:01.026 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:49:01.028 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:49:16.106 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:49:16.107 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:49:31.182 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:49:31.184 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:49:46.270 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:49:46.272 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:50:01.346 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:50:01.348 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:50:16.418 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:50:16.420 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:50:31.502 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:50:31.503 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:50:46.598 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:50:46.600 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:51:01.686 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:51:01.688 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:51:16.778 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:51:16.779 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:51:31.864 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:51:31.866 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:51:46.958 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:51:46.960 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:52:02.062 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:52:02.063 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:52:17.158 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-15T04:52:17.160 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:52:17.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:52:32.241 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-15T04:52:32.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:52:35.422 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-15T04:52:41.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:52:44.506 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-15T04:52:50.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:52:53.562 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-15T04:52:59.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:53:02.618 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-15T04:53:08.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:53:11.674 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-15T04:53:17.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:53:20.734 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-15T04:53:26.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:53:47.804 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-11-15T04:53:54.878 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-15T04:53:58.940 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T04:53:58.941 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T04:54:00.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:54:01.252 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T04:54:01.253 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T04:54:17.982 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-11-15T04:54:20.665 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-11-15T04:54:20.666 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-11-15T04:54:20.675 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-11-15T04:54:20.675 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-11-15T04:54:20.722 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-11-15T04:54:20.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-11-15T04:54:20.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-11-15T04:54:20.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-11-15T04:54:20.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-11-15T04:54:20.851 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-11-15T04:54:20.911 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-11-15T04:54:20.916 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2023-11-15T04:54:20.916 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-15T04:54:20.916 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2023-11-15T04:54:20.916 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2023-11-15T04:54:20.917 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-15T04:54:20.917 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="20.04" 2023-11-15T04:54:20.917 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-15T04:54:20.917 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-15T04:54:20.917 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-15T04:54:20.918 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-15T04:54:20.918 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=focal 2023-11-15T04:54:20.918 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=focal 2023-11-15T04:54:20.919 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-11-15T04:54:20.920 DEBUG:teuthology.parallel:result is None 2023-11-15T04:54:22.130 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-11-15T04:54:22.131 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-11-15T04:54:22.137 INFO:teuthology.orchestra.run.smithi133.stdout:smithi129 2023-11-15T04:54:22.138 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi129 /etc/hosts 2023-11-15T04:54:22.145 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.129 smithi129 smithi129 2023-11-15T04:54:22.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-11-15T04:54:22.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi129/smithi133/g' /etc/hosts 2023-11-15T04:54:22.281 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.129/172.21.15.133/g' /etc/hosts 2023-11-15T04:54:22.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi129/smithi133/g' /etc/hostname 2023-11-15T04:54:22.355 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-11-15T04:54:22.375 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-11-15T04:54:22.379 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-11-15T04:54:22.380 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-15T04:54:22.380 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-11-15T04:54:22.380 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-11-15T04:54:22.380 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-15T04:54:22.380 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-11-15T04:54:22.381 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-15T04:54:22.381 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-15T04:54:22.381 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-15T04:54:22.381 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-15T04:54:22.381 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-11-15T04:54:22.382 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-11-15T04:54:22.382 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-11-15T04:54:22.383 DEBUG:teuthology.parallel:result is None 2023-11-15T04:54:22.596 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-11-15T04:54:22.597 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T04:54:22.624 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-11-15T04:54:22.625 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T04:54:22.651 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-11-15T04:54:22.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-15T04:54:22.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:54:22.702 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-11-15T04:54:22.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-15T04:54:22.824 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-11-15T04:54:22.830 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-11-15T04:54:22.831 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-11-15T04:54:22.838 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2023-11-15T04:54:22.838 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-15T04:54:22.838 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2023-11-15T04:54:22.838 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2023-11-15T04:54:22.838 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-15T04:54:22.839 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="20.04" 2023-11-15T04:54:22.839 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-15T04:54:22.839 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-15T04:54:22.839 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-15T04:54:22.839 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-15T04:54:22.840 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=focal 2023-11-15T04:54:22.840 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=focal 2023-11-15T04:54:22.840 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-15T04:54:22.874 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-11-15T04:54:22.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-15T04:54:22.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:54:22.925 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-11-15T04:54:23.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-15T04:54:23.044 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-11-15T04:54:23.050 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-11-15T04:54:23.050 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-11-15T04:54:23.098 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-11-15T04:54:23.098 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-15T04:54:23.098 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-11-15T04:54:23.099 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-11-15T04:54:23.099 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-15T04:54:23.099 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-11-15T04:54:23.099 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-15T04:54:23.099 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-15T04:54:23.100 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-15T04:54:23.100 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-15T04:54:23.100 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-11-15T04:54:23.100 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-11-15T04:54:23.101 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-11-15T04:54:23.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:54:23.234 INFO:teuthology.dispatcher.supervisor:Running job 7458434 2023-11-15T04:54:23.234 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458434 --name yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} -- /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458434/orig.config.yaml 2023-11-15T04:54:23.238 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458434 2023-11-15T04:54:23.238 INFO:teuthology.dispatcher.supervisor:Job PID: 3469257 2023-11-15T04:54:23.239 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-15T04:56:23.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:58:23.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:00:23.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:02:23.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:04:24.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:06:24.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:08:24.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:10:24.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:12:24.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:14:24.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:16:25.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:18:25.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:20:25.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:20:25.460 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-15T05:20:25.597 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-15T05:20:25.597 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T05:20:25.650 DEBUG:teuthology.nuke:shortname: smithi112 2023-11-15T05:20:25.651 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T05:20:25.671 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458434', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 04:48:23.378867', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-15T05:20:25.674 DEBUG:teuthology.nuke:shortname: smithi133 2023-11-15T05:20:25.675 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T05:20:25.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458434', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 04:48:23.377052', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-15T05:20:25.727 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-15T05:20:25.728 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T05:20:25.752 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-15T05:20:25.752 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T05:20:25.770 INFO:teuthology.orchestra.console.smithi133:Power off 2023-11-15T05:20:25.771 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T05:20:25.780 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-15T05:20:25.792 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-11-15T05:20:25.792 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T05:20:25.817 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-15T05:20:25.882 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-15T05:20:25.919 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-11-15T05:20:26.034 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2023-11-15T05:20:26.067 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com