2023-11-04T23:53:28.921 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T23:53:28.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:53:29.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5c5410670>, signals=[15]) 2023-11-04T23:53:29.073 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-11-04T23:53:29.074 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T23:53:29.074 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-11-04T23:53:29.099 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-11-04T23:53:29.100 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T23:53:29.100 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-11-04T23:53:29.102 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /host {"name": "smithi052"} 2023-11-04T23:53:29.123 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-11-04T23:53:29.179 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-04T23:53:29.192 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-04T23:53:29.223 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-04T23:53:29.223 DEBUG:teuthology.provision.fog.smithi052:FOG request: PUT /host/157 {"imageID": 2} 2023-11-04T23:53:29.236 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-04T23:53:29.237 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 2} 2023-11-04T23:53:29.279 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of ubuntu 20.04 2023-11-04T23:53:29.280 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:53:29.287 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of ubuntu 20.04 2023-11-04T23:53:29.287 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:53:29.375 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T23:53:29.385 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T23:53:29.439 DEBUG:teuthology.provision.fog.smithi052:FOG request: POST /host/157/task {"taskTypeID": 1} 2023-11-04T23:53:29.443 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-11-04T23:53:29.501 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:53:29.571 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:53:29.649 INFO:teuthology.orchestra.console.smithi052:Power off 2023-11-04T23:53:29.650 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T23:53:29.687 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-11-04T23:53:29.688 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:29.705 INFO:teuthology.orchestra.console.smithi060:Power off 2023-11-04T23:53:29.706 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T23:53:29.717 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-04T23:53:29.748 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-11-04T23:53:29.749 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:29.785 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-11-04T23:53:33.722 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:33.786 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:33.831 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-04T23:53:33.896 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-11-04T23:53:37.834 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:37.897 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:37.943 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-04T23:53:38.007 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-04T23:53:38.044 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-11-04T23:53:38.108 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-11-04T23:53:38.146 INFO:teuthology.orchestra.console.smithi052:Power on 2023-11-04T23:53:38.146 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T23:53:38.168 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On 2023-11-04T23:53:38.169 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:38.189 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-04T23:53:38.210 INFO:teuthology.orchestra.console.smithi060:Power on 2023-11-04T23:53:38.210 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T23:53:38.230 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On 2023-11-04T23:53:38.231 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:38.254 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-04T23:53:42.190 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:42.256 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:42.299 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-04T23:53:42.366 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-04T23:53:46.302 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:46.367 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:53:46.411 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-04T23:53:46.476 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-11-04T23:53:46.512 INFO:teuthology.orchestra.console.smithi052:Power on completed 2023-11-04T23:53:46.578 INFO:teuthology.orchestra.console.smithi060:Power on completed 2023-11-04T23:53:46.614 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-11-04T23:53:46.614 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:53:46.679 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-11-04T23:53:46.680 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:54:01.702 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:54:01.747 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:54:16.779 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:54:16.820 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:54:31.874 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:54:31.881 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:54:46.962 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:54:46.964 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:55:02.050 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:55:02.052 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:55:17.159 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:55:17.161 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:55:32.258 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:55:32.260 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:55:47.361 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:55:47.363 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:56:02.454 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:56:02.456 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:56:17.552 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:56:17.554 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:56:32.658 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:56:32.660 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:56:47.746 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:56:47.748 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:57:02.842 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:57:02.844 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:57:17.930 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-04T23:57:17.932 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-11-04T23:57:17.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:18.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:21.050 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-04T23:57:21.051 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-04T23:57:27.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:27.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:30.110 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-04T23:57:30.111 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-04T23:57:36.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:36.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:39.194 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-04T23:57:39.195 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-04T23:57:45.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:45.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:48.254 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-04T23:57:48.286 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-04T23:57:54.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:54.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:57:57.338 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-04T23:57:57.339 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-04T23:58:03.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:58:03.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:58:06.394 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-04T23:58:12.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:59:03.395 WARNING:teuthology.provision.fog.smithi060:timed out 2023-11-04T23:59:09.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:59:09.529 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T23:59:09.530 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T23:59:10.077 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-11-04T23:59:10.077 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-11-04T23:59:10.083 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2023-11-04T23:59:10.084 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2023-11-04T23:59:10.091 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-11-04T23:59:10.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-11-04T23:59:10.237 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2023-11-04T23:59:10.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-11-04T23:59:10.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2023-11-04T23:59:10.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-11-04T23:59:10.338 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-11-04T23:59:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2023-11-04T23:59:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-04T23:59:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2023-11-04T23:59:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2023-11-04T23:59:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-04T23:59:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="20.04" 2023-11-04T23:59:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:59:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:59:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:59:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:59:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=focal 2023-11-04T23:59:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=focal 2023-11-04T23:59:10.347 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-11-04T23:59:10.348 DEBUG:teuthology.parallel:result is None 2023-11-04T23:59:12.402 WARNING:teuthology.provision.fog.smithi052:timed out 2023-11-04T23:59:18.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:59:18.549 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T23:59:18.549 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T23:59:19.018 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-11-04T23:59:19.019 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2023-11-04T23:59:19.065 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-11-04T23:59:19.066 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2023-11-04T23:59:19.073 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-11-04T23:59:19.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-11-04T23:59:19.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2023-11-04T23:59:19.186 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2023-11-04T23:59:19.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2023-11-04T23:59:19.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-11-04T23:59:19.275 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-11-04T23:59:19.282 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2023-11-04T23:59:19.282 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-04T23:59:19.283 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2023-11-04T23:59:19.283 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2023-11-04T23:59:19.283 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-04T23:59:19.283 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="20.04" 2023-11-04T23:59:19.283 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:59:19.284 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:59:19.284 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:59:19.284 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:59:19.284 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=focal 2023-11-04T23:59:19.285 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=focal 2023-11-04T23:59:19.285 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2023-11-04T23:59:19.285 DEBUG:teuthology.parallel:result is None 2023-11-04T23:59:19.523 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2023-11-04T23:59:19.524 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T23:59:19.547 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-11-04T23:59:19.547 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T23:59:19.573 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2023-11-04T23:59:19.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-04T23:59:19.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:59:19.626 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-11-04T23:59:19.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-04T23:59:19.748 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-11-04T23:59:19.754 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-11-04T23:59:19.755 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-11-04T23:59:19.761 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2023-11-04T23:59:19.761 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-04T23:59:19.761 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2023-11-04T23:59:19.761 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2023-11-04T23:59:19.762 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-04T23:59:19.762 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="20.04" 2023-11-04T23:59:19.762 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:59:19.762 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:59:19.762 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:59:19.763 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:59:19.763 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=focal 2023-11-04T23:59:19.763 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=focal 2023-11-04T23:59:19.763 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-11-04T23:59:19.789 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-11-04T23:59:19.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-11-04T23:59:19.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:59:19.841 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-11-04T23:59:19.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-11-04T23:59:19.968 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-11-04T23:59:19.975 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-11-04T23:59:19.975 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-11-04T23:59:19.981 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2023-11-04T23:59:19.981 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-04T23:59:19.981 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2023-11-04T23:59:19.981 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2023-11-04T23:59:19.982 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-04T23:59:19.982 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="20.04" 2023-11-04T23:59:19.982 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:59:19.982 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:59:19.983 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:59:19.984 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:59:19.984 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=focal 2023-11-04T23:59:19.984 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=focal 2023-11-04T23:59:19.984 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-11-04T23:59:20.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:59:20.095 INFO:teuthology.dispatcher.supervisor:Running job 7447383 2023-11-04T23:59:20.096 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447383 --name yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447383/orig.config.yaml 2023-11-04T23:59:20.099 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447383 2023-11-04T23:59:20.100 INFO:teuthology.dispatcher.supervisor:Job PID: 2200893 2023-11-04T23:59:20.101 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-05T00:01:20.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:03:20.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:05:20.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:07:20.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:09:20.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:11:21.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:13:21.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:15:21.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:17:21.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:19:21.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:21:21.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:23:22.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:25:22.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:27:22.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:29:22.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:29:22.658 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-05T00:29:22.814 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-05T00:29:22.815 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T00:29:22.865 DEBUG:teuthology.nuke:shortname: smithi052 2023-11-05T00:29:22.865 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T00:29:22.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 23:53:28.101503', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-05T00:29:22.893 DEBUG:teuthology.nuke:shortname: smithi060 2023-11-05T00:29:22.893 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T00:29:22.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 23:53:28.100327', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-05T00:29:22.946 INFO:teuthology.orchestra.console.smithi052:Power off 2023-11-05T00:29:22.946 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:29:22.968 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-11-05T00:29:22.969 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:29:22.982 INFO:teuthology.orchestra.console.smithi060:Power off 2023-11-05T00:29:22.983 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:29:22.991 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-05T00:29:23.002 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-11-05T00:29:23.002 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:29:23.022 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-05T00:29:23.093 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-11-05T00:29:23.124 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-11-05T00:29:23.239 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com 2023-11-05T00:29:23.273 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com