2023-10-28T22:20:02.479 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-28T22:20:02.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:20:02.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4028af3670>, signals=[15]) 2023-10-28T22:20:02.630 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-10-28T22:20:02.630 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-10-28T22:20:02.630 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-28T22:20:02.655 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-10-28T22:20:02.656 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-10-28T22:20:02.656 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-10-28T22:20:02.657 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-10-28T22:20:02.680 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"} 2023-10-28T22:20:02.734 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-28T22:20:02.745 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-28T22:20:02.776 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-28T22:20:02.777 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 6} 2023-10-28T22:20:02.787 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-28T22:20:02.788 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 6} 2023-10-28T22:20:02.825 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of ubuntu 22.04 2023-10-28T22:20:02.826 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:20:02.833 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of ubuntu 22.04 2023-10-28T22:20:02.833 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:20:02.865 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-10-28T22:20:02.874 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"} 2023-10-28T22:20:02.900 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-10-28T22:20:02.909 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1} 2023-10-28T22:20:02.953 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:20:02.982 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:20:03.029 INFO:teuthology.orchestra.console.smithi110:Power off 2023-10-28T22:20:03.030 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-28T22:20:03.054 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-10-28T22:20:03.055 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:03.070 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-28T22:20:03.071 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-28T22:20:03.080 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-10-28T22:20:03.099 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-28T22:20:03.100 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:03.122 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-28T22:20:07.083 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:07.124 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:07.196 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-10-28T22:20:07.234 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-28T22:20:11.198 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:11.235 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:11.308 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-10-28T22:20:11.347 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-28T22:20:11.410 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-10-28T22:20:11.448 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-28T22:20:11.511 INFO:teuthology.orchestra.console.smithi110:Power on 2023-10-28T22:20:11.512 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-28T22:20:11.532 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2023-10-28T22:20:11.533 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:11.550 INFO:teuthology.orchestra.console.smithi032:Power on 2023-10-28T22:20:11.551 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-28T22:20:11.560 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-10-28T22:20:11.571 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2023-10-28T22:20:11.572 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:11.595 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-28T22:20:15.562 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:15.596 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:15.672 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-10-28T22:20:15.706 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-28T22:20:19.675 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:19.707 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T22:20:19.796 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-10-28T22:20:19.816 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-28T22:20:19.897 INFO:teuthology.orchestra.console.smithi110:Power on completed 2023-10-28T22:20:19.918 INFO:teuthology.orchestra.console.smithi032:Power on completed 2023-10-28T22:20:19.999 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-10-28T22:20:19.999 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:20:20.019 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-10-28T22:20:20.020 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:20:35.066 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:20:35.070 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:20:50.134 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:20:50.136 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:21:05.202 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:21:05.204 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:21:20.256 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:21:20.260 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:21:35.326 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:21:35.328 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:21:50.398 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:21:50.400 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:22:05.470 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:22:05.472 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:22:20.554 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:22:20.556 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:22:35.624 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:22:35.626 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:22:50.695 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:22:50.697 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:23:05.771 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:23:05.773 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:23:20.846 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:23:20.848 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-28T22:23:20.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:23:35.919 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-10-28T22:23:35.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:23:39.387 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-28T22:23:45.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:23:48.446 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-28T22:23:54.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:23:54.490 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-10-28T22:23:57.534 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-28T22:24:00.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:24:03.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:24:03.546 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-10-28T22:24:09.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:24:12.606 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-10-28T22:24:18.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:24:21.694 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-10-28T22:24:27.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:25:03.578 WARNING:teuthology.provision.fog.smithi032:timed out 2023-10-28T22:25:09.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:25:09.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-28T22:25:09.755 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-28T22:25:10.149 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-10-28T22:25:10.149 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-10-28T22:25:10.195 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-10-28T22:25:10.196 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-10-28T22:25:10.244 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-10-28T22:25:10.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-10-28T22:25:10.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-10-28T22:25:10.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-10-28T22:25:10.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-10-28T22:25:10.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-10-28T22:25:10.600 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-28T22:25:10.652 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-28T22:25:10.652 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2023-10-28T22:25:10.652 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2023-10-28T22:25:10.653 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-28T22:25:10.653 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2023-10-28T22:25:10.653 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2023-10-28T22:25:10.653 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2023-10-28T22:25:10.653 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-28T22:25:10.654 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-28T22:25:10.654 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-28T22:25:10.654 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-28T22:25:10.654 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2023-10-28T22:25:10.655 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-10-28T22:25:10.657 DEBUG:teuthology.parallel:result is None 2023-10-28T22:25:27.706 WARNING:teuthology.provision.fog.smithi110:timed out 2023-10-28T22:25:33.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:25:33.947 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-28T22:25:33.948 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-28T22:25:34.458 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-10-28T22:25:34.458 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-10-28T22:25:34.508 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-10-28T22:25:34.508 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-10-28T22:25:34.556 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-10-28T22:25:34.556 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-10-28T22:25:34.712 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-10-28T22:25:34.726 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-10-28T22:25:34.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-10-28T22:25:34.844 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-10-28T22:25:34.903 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-10-28T22:25:34.956 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-28T22:25:34.956 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2023-10-28T22:25:34.956 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2023-10-28T22:25:34.956 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-28T22:25:34.956 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2023-10-28T22:25:34.957 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2023-10-28T22:25:34.957 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2023-10-28T22:25:34.957 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-28T22:25:34.957 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-28T22:25:34.957 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-28T22:25:34.958 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-28T22:25:34.958 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2023-10-28T22:25:34.958 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-10-28T22:25:34.959 DEBUG:teuthology.parallel:result is None 2023-10-28T22:25:35.143 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-10-28T22:25:35.144 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-28T22:25:35.168 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-10-28T22:25:35.168 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-28T22:25:35.194 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-10-28T22:25:35.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-28T22:25:35.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:25:35.268 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-10-28T22:25:35.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-28T22:25:35.496 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-10-28T22:25:35.544 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-10-28T22:25:35.545 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-28T22:25:35.596 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-28T22:25:35.596 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2023-10-28T22:25:35.596 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2023-10-28T22:25:35.597 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-28T22:25:35.597 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2023-10-28T22:25:35.597 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2023-10-28T22:25:35.597 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2023-10-28T22:25:35.598 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-28T22:25:35.598 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-28T22:25:35.598 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-28T22:25:35.599 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-28T22:25:35.599 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2023-10-28T22:25:35.600 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-28T22:25:35.627 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-10-28T22:25:35.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-28T22:25:35.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-28T22:25:35.708 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-10-28T22:25:35.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-28T22:25:35.822 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-10-28T22:25:35.871 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-10-28T22:25:35.871 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-10-28T22:25:35.919 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-28T22:25:35.920 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2023-10-28T22:25:35.920 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2023-10-28T22:25:35.920 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-28T22:25:35.920 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2023-10-28T22:25:35.921 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2023-10-28T22:25:35.921 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2023-10-28T22:25:35.921 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-28T22:25:35.921 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-28T22:25:35.921 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-28T22:25:35.922 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-28T22:25:35.922 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2023-10-28T22:25:35.922 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-10-28T22:25:35.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:25:36.039 INFO:teuthology.dispatcher.supervisor:Running job 7439661 2023-10-28T22:25:36.040 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-10-28_20:37:39-rbd-wip-dis-testing-distro-default-smithi/7439661 --name dis-2023-10-28_20:37:39-rbd-wip-dis-testing-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} -- /home/teuthworker/archive/dis-2023-10-28_20:37:39-rbd-wip-dis-testing-distro-default-smithi/7439661/orig.config.yaml 2023-10-28T22:25:36.043 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-10-28_20:37:39-rbd-wip-dis-testing-distro-default-smithi/7439661 2023-10-28T22:25:36.044 INFO:teuthology.dispatcher.supervisor:Job PID: 1121930 2023-10-28T22:25:36.044 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-28T22:27:36.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:29:36.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:31:36.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:33:36.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:35:36.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:37:36.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:39:37.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:41:37.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:43:37.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:45:37.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:47:37.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:49:37.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:51:38.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:53:38.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:55:38.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:57:38.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T22:59:38.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:01:38.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:03:39.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:05:39.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:07:39.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:09:39.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:11:39.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:13:39.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:15:40.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:17:40.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:19:40.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:21:40.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:23:40.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-28T23:23:40.700 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-28T23:23:40.885 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-28T23:23:40.885 INFO:teuthology.nuke:Checking targets against current locks 2023-10-28T23:23:40.931 DEBUG:teuthology.nuke:shortname: smithi032 2023-10-28T23:23:40.932 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-28T23:23:40.953 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-10-28_20:37:39-rbd-wip-dis-testing-distro-default-smithi/7439661', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-28 22:20:01.660386', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPdosmuyd4jY208ChRw65EqbPo84EEAjLSlLHYo+t9apn+8GxrEN5ppPpRLhzEXdMtYCbchMqNrHYfq0coeA4HA='} 2023-10-28T23:23:40.956 DEBUG:teuthology.nuke:shortname: smithi110 2023-10-28T23:23:40.957 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-28T23:23:40.975 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-10-28_20:37:39-rbd-wip-dis-testing-distro-default-smithi/7439661', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-28 22:20:01.662006', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQOEizfr4KCfpkdmWW3LEz8uqK3it8FnnPam9+sJmFrBiCg/D/TniEXBU/gx+rlleHPRXOW0wHDagsXpNlzcWg='} 2023-10-28T23:23:41.005 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-28T23:23:41.005 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-28T23:23:41.018 INFO:teuthology.orchestra.console.smithi110:Power off 2023-10-28T23:23:41.018 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-28T23:23:41.027 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-28T23:23:41.028 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T23:23:41.038 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-10-28T23:23:41.039 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-28T23:23:41.047 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-28T23:23:41.058 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-10-28T23:23:41.149 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-28T23:23:41.160 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-10-28T23:23:41.299 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-10-28T23:23:41.307 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com