2024-01-15T23:18:13.280 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-15T23:18:13.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:18:13.449 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9a969ac10>, signals=[15]) 2024-01-15T23:18:13.449 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2024-01-15T23:18:13.450 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2024-01-15T23:18:13.450 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-01-15T23:18:13.473 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2024-01-15T23:18:13.474 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2024-01-15T23:18:13.474 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-01-15T23:18:13.498 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2024-01-15T23:18:13.498 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2024-01-15T23:18:13.498 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-01-15T23:18:13.591 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-15T23:18:13.623 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-15T23:18:13.629 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-15T23:18:13.641 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of ubuntu 22.04 2024-01-15T23:18:13.667 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of ubuntu 22.04 2024-01-15T23:18:13.670 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of ubuntu 22.04 2024-01-15T23:18:13.900 INFO:teuthology.orchestra.console.smithi188:Power off 2024-01-15T23:18:13.901 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T23:18:13.912 INFO:teuthology.orchestra.console.smithi040:Power off 2024-01-15T23:18:13.912 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T23:18:13.922 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-01-15T23:18:13.922 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:13.933 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-01-15T23:18:13.933 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:13.946 INFO:teuthology.orchestra.console.smithi160:Power off 2024-01-15T23:18:13.946 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T23:18:13.953 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-01-15T23:18:13.954 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-01-15T23:18:13.966 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-01-15T23:18:13.966 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:13.989 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-15T23:18:14.055 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-01-15T23:18:14.055 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-01-15T23:18:14.090 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-01-15T23:18:14.156 INFO:teuthology.orchestra.console.smithi040:Power on 2024-01-15T23:18:14.156 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-15T23:18:14.163 INFO:teuthology.orchestra.console.smithi188:Power on 2024-01-15T23:18:14.163 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-15T23:18:14.181 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2024-01-15T23:18:14.181 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:14.189 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2024-01-15T23:18:14.190 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:14.196 INFO:teuthology.orchestra.console.smithi160:Power on 2024-01-15T23:18:14.196 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-15T23:18:14.205 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-01-15T23:18:14.210 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-01-15T23:18:14.217 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2024-01-15T23:18:14.217 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:14.243 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-15T23:18:18.208 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:18.215 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:18.244 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:18.317 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-01-15T23:18:18.323 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-01-15T23:18:18.352 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-01-15T23:18:18.424 INFO:teuthology.orchestra.console.smithi188:Power on completed 2024-01-15T23:18:18.454 INFO:teuthology.orchestra.console.smithi160:Power on completed 2024-01-15T23:18:18.525 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2024-01-15T23:18:18.554 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2024-01-15T23:18:22.321 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:18:22.458 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-01-15T23:18:22.559 INFO:teuthology.orchestra.console.smithi040:Power on completed 2024-01-15T23:18:22.660 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2024-01-15T23:21:23.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:21:23.702 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T23:21:34.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:21:34.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:21:37.696 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-15T23:21:37.724 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-01-15T23:21:43.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:21:43.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:21:46.784 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-15T23:21:46.785 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-01-15T23:21:52.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:21:52.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:21:55.840 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-15T23:21:55.868 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-01-15T23:22:01.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:01.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:04.896 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-15T23:22:04.928 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-01-15T23:22:10.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:10.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:13.948 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-15T23:22:13.980 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-01-15T23:22:19.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:19.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:23.004 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-15T23:22:27.705 WARNING:teuthology.provision.fog.smithi040:timed out 2024-01-15T23:22:29.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:32.064 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-15T23:22:33.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:38.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:22:52.092 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-01-15T23:22:58.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:00.124 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-01-15T23:23:06.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:06.127 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-01-15T23:23:12.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:12.131 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-01-15T23:23:18.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:19.984 WARNING:teuthology.provision.fog.smithi188:timed out 2024-01-15T23:23:25.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:26.209 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-15T23:23:26.210 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-15T23:23:26.644 INFO:teuthology.provision.fog.smithi188:Node is ready 2024-01-15T23:23:26.644 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2024-01-15T23:23:26.691 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2024-01-15T23:23:26.691 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2024-01-15T23:23:26.744 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2024-01-15T23:23:26.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-01-15T23:23:26.891 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2024-01-15T23:23:26.905 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2024-01-15T23:23:26.960 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2024-01-15T23:23:27.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-01-15T23:23:27.071 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-01-15T23:23:27.119 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T23:23:27.119 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2024-01-15T23:23:27.119 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="22.04" 2024-01-15T23:23:27.119 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T23:23:27.119 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=jammy 2024-01-15T23:23:27.119 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2024-01-15T23:23:27.120 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2024-01-15T23:23:27.120 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T23:23:27.120 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T23:23:27.120 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T23:23:27.120 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T23:23:27.120 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=jammy 2024-01-15T23:23:27.121 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2024-01-15T23:23:27.122 DEBUG:teuthology.parallel:result is None 2024-01-15T23:23:33.744 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-15T23:23:33.744 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-15T23:23:34.173 INFO:teuthology.provision.fog.smithi040:Node is ready 2024-01-15T23:23:34.173 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2024-01-15T23:23:34.219 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2024-01-15T23:23:34.219 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2024-01-15T23:23:34.268 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2024-01-15T23:23:34.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-01-15T23:23:34.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2024-01-15T23:23:34.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2024-01-15T23:23:34.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2024-01-15T23:23:34.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-01-15T23:23:34.619 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04" 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2024-01-15T23:23:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T23:23:34.669 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T23:23:34.669 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T23:23:34.669 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T23:23:34.669 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy 2024-01-15T23:23:34.669 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2024-01-15T23:23:34.670 DEBUG:teuthology.parallel:result is None 2024-01-15T23:23:38.068 WARNING:teuthology.provision.fog.smithi160:timed out 2024-01-15T23:23:44.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:44.541 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-15T23:23:44.541 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-15T23:23:44.985 INFO:teuthology.provision.fog.smithi160:Node is ready 2024-01-15T23:23:44.986 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2024-01-15T23:23:45.031 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2024-01-15T23:23:45.032 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2024-01-15T23:23:45.080 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2024-01-15T23:23:45.081 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2024-01-15T23:23:45.204 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2024-01-15T23:23:45.218 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2024-01-15T23:23:45.273 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2024-01-15T23:23:45.329 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2024-01-15T23:23:45.383 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2024-01-15T23:23:45.428 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T23:23:45.429 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T23:23:45.429 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T23:23:45.429 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T23:23:45.429 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2024-01-15T23:23:45.429 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2024-01-15T23:23:45.430 DEBUG:teuthology.parallel:result is None 2024-01-15T23:23:45.700 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2024-01-15T23:23:45.701 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-15T23:23:45.724 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2024-01-15T23:23:45.724 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-15T23:23:45.765 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2024-01-15T23:23:45.766 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-15T23:23:45.783 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2024-01-15T23:23:45.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-01-15T23:23:45.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:45.868 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-01-15T23:23:45.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-01-15T23:23:45.977 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-01-15T23:23:46.023 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-01-15T23:23:46.024 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-01-15T23:23:46.076 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T23:23:46.076 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2024-01-15T23:23:46.076 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04" 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T23:23:46.077 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy 2024-01-15T23:23:46.077 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-01-15T23:23:46.099 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2024-01-15T23:23:46.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-15T23:23:46.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:46.177 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-01-15T23:23:46.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-15T23:23:46.280 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-01-15T23:23:46.331 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-01-15T23:23:46.331 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-01-15T23:23:46.379 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T23:23:46.380 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2024-01-15T23:23:46.381 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-01-15T23:23:46.408 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2024-01-15T23:23:46.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-01-15T23:23:46.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T23:23:46.504 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-01-15T23:23:46.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-01-15T23:23:46.728 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-01-15T23:23:46.774 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-01-15T23:23:46.775 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="22.04" 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=jammy 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T23:23:46.823 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T23:23:46.824 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T23:23:46.824 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=jammy 2024-01-15T23:23:46.824 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-01-15T23:23:46.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:23:46.946 INFO:teuthology.dispatcher.supervisor:Running job 7517803 2024-01-15T23:23:46.946 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2024-01-15_22:53:26-rbd-wip-dis-testing-1-distro-default-smithi/7517803 --name dis-2024-01-15_22:53:26-rbd-wip-dis-testing-1-distro-default-smithi --description rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/none extra-conf/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} -- /home/teuthworker/archive/dis-2024-01-15_22:53:26-rbd-wip-dis-testing-1-distro-default-smithi/7517803/orig.config.yaml 2024-01-15T23:23:46.950 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2024-01-15_22:53:26-rbd-wip-dis-testing-1-distro-default-smithi/7517803 2024-01-15T23:23:46.950 INFO:teuthology.dispatcher.supervisor:Job PID: 3692714 2024-01-15T23:23:46.950 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-15T23:25:46.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:27:47.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:29:47.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:31:47.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:33:47.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:35:47.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:37:47.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:39:47.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:41:47.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T23:41:47.608 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-15T23:41:47.718 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-15T23:41:47.718 INFO:teuthology.nuke:Checking targets against current locks 2024-01-15T23:41:47.768 DEBUG:teuthology.nuke:shortname: smithi040 2024-01-15T23:41:47.768 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-15T23:41:47.790 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-01-15_22:53:26-rbd-wip-dis-testing-1-distro-default-smithi/7517803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 23:18:12.247693', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPgCLli5HQsrAn8PGhxf7QEp1XskAiByLmgffXZT10zaegw2DNT7zWsY8C3crifWrThugm3DyRljz/txPc9O7zo='} 2024-01-15T23:41:47.790 DEBUG:teuthology.nuke:shortname: smithi160 2024-01-15T23:41:47.791 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-15T23:41:47.811 DEBUG:teuthology.nuke:shortname: smithi188 2024-01-15T23:41:47.812 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-15T23:41:47.818 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-01-15_22:53:26-rbd-wip-dis-testing-1-distro-default-smithi/7517803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 23:18:12.244306', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNnrDAvYVpDXB6m56w+QYDhXUVVaqqgS+SnrtmSdRFgiN77+NQo/MAuw4f3BEAPR+YdXsdk6kI81RpsY5hrjSLE='} 2024-01-15T23:41:47.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-01-15_22:53:26-rbd-wip-dis-testing-1-distro-default-smithi/7517803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 23:18:12.246151', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0W0tdiiYreRicjV2TR6fhoCXbWASuiqW/Tl81JaZKiemOu/9adbZZPvL010sDWhdPW7vV8jr8zo3wClJYJ77c='} 2024-01-15T23:41:47.846 INFO:teuthology.orchestra.console.smithi040:Power off 2024-01-15T23:41:47.846 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T23:41:47.868 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-01-15T23:41:47.868 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:41:47.882 INFO:teuthology.orchestra.console.smithi188:Power off 2024-01-15T23:41:47.882 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T23:41:47.893 INFO:teuthology.orchestra.console.smithi160:Power off 2024-01-15T23:41:47.893 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T23:41:47.903 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-01-15T23:41:47.904 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-01-15T23:41:47.904 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:41:47.916 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-01-15T23:41:47.916 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T23:41:47.926 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-01-15T23:41:47.936 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-15T23:41:48.004 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-01-15T23:41:48.026 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-01-15T23:41:48.037 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-01-15T23:41:48.156 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2024-01-15T23:41:48.173 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com 2024-01-15T23:41:48.181 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com