2024-02-06T00:38:20.371 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-06T00:38:20.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:38:20.579 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efd031c9c10>, signals=[15]) 2024-02-06T00:38:20.580 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging 2024-02-06T00:38:20.580 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server 2024-02-06T00:38:20.581 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-02-06T00:38:20.609 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2024-02-06T00:38:20.609 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2024-02-06T00:38:20.609 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-02-06T00:38:20.634 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-02-06T00:38:20.634 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-02-06T00:38:20.634 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-06T00:38:20.733 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-06T00:38:20.751 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-06T00:38:20.765 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-06T00:38:20.785 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of ubuntu 22.04 2024-02-06T00:38:20.788 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 22.04 2024-02-06T00:38:20.806 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 22.04 2024-02-06T00:38:21.016 INFO:teuthology.orchestra.console.smithi001:Power off 2024-02-06T00:38:21.016 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-06T00:38:21.032 INFO:teuthology.orchestra.console.smithi161:Power off 2024-02-06T00:38:21.032 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-06T00:38:21.045 INFO:teuthology.orchestra.console.smithi033:Power off 2024-02-06T00:38:21.045 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-06T00:38:21.055 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2024-02-06T00:38:21.055 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:21.064 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-02-06T00:38:21.064 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:21.072 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-02-06T00:38:21.073 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:21.081 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-02-06T00:38:21.087 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-06T00:38:21.094 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-06T00:38:21.188 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-02-06T00:38:21.288 INFO:teuthology.orchestra.console.smithi161:Power on 2024-02-06T00:38:21.289 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-06T00:38:21.309 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-02-06T00:38:21.309 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:21.330 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-06T00:38:25.084 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:25.095 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:25.194 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-02-06T00:38:25.204 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-06T00:38:25.331 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:25.440 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-06T00:38:25.541 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-02-06T00:38:25.642 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-02-06T00:38:29.196 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:29.204 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:29.306 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-02-06T00:38:29.313 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-06T00:38:33.308 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:33.315 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:33.418 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-02-06T00:38:33.424 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-02-06T00:38:33.520 INFO:teuthology.orchestra.console.smithi001:Power off completed 2024-02-06T00:38:33.525 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-02-06T00:38:33.621 INFO:teuthology.orchestra.console.smithi001:Power on 2024-02-06T00:38:33.621 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-06T00:38:33.628 INFO:teuthology.orchestra.console.smithi033:Power on 2024-02-06T00:38:33.628 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-06T00:38:33.642 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On 2024-02-06T00:38:33.643 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:33.651 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2024-02-06T00:38:33.651 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:33.663 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-02-06T00:38:33.672 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-02-06T00:38:37.668 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:37.676 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:37.778 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-02-06T00:38:37.784 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-02-06T00:38:37.880 INFO:teuthology.orchestra.console.smithi001:Power on completed 2024-02-06T00:38:37.980 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2024-02-06T00:38:41.786 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T00:38:41.895 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-06T00:38:41.996 INFO:teuthology.orchestra.console.smithi033:Power on completed 2024-02-06T00:38:42.096 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2024-02-06T00:41:38.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:41:41.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:41:41.856 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:41:42.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:41:45.884 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-02-06T00:41:47.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:41:50.908 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:41:51.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:41:54.940 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-02-06T00:41:56.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:41:59.964 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:42:00.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:03.996 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-02-06T00:42:05.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:09.020 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:42:09.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:11.709 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-02-06T00:42:13.056 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-02-06T00:42:15.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:18.080 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:42:19.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:24.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:27.132 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:42:33.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:36.188 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:42:42.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:42:50.300 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-06T00:42:56.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:13.600 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:43:14.620 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-06T00:43:19.060 WARNING:teuthology.provision.fog.smithi033:timed out 2024-02-06T00:43:19.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:19.604 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:43:20.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:23.708 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-06T00:43:25.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:25.064 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-02-06T00:43:25.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:25.607 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:43:29.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:29.712 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-06T00:43:31.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:31.274 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-06T00:43:31.275 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-06T00:43:31.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:31.713 INFO:teuthology.provision.fog.smithi033:Node is ready 2024-02-06T00:43:31.713 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2024-02-06T00:43:31.760 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2024-02-06T00:43:31.760 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2024-02-06T00:43:31.808 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2024-02-06T00:43:31.808 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-02-06T00:43:31.965 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2024-02-06T00:43:31.980 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2024-02-06T00:43:32.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2024-02-06T00:43:32.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-02-06T00:43:32.151 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-06T00:43:32.200 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-06T00:43:32.201 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-06T00:43:32.201 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-06T00:43:32.201 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2024-02-06T00:43:32.201 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2024-02-06T00:43:32.203 DEBUG:teuthology.parallel:result is None 2024-02-06T00:43:35.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:35.715 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-06T00:43:35.868 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-02-06T00:43:37.186 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-06T00:43:41.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:41.722 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-06T00:43:43.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:43.405 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-06T00:43:43.405 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-06T00:43:43.871 INFO:teuthology.provision.fog.smithi001:Node is ready 2024-02-06T00:43:43.871 DEBUG:teuthology.orchestra.run.smithi001:> hostname 2024-02-06T00:43:43.919 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com 2024-02-06T00:43:43.919 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts 2024-02-06T00:43:43.968 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001 2024-02-06T00:43:43.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2024-02-06T00:43:44.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts 2024-02-06T00:43:44.118 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts 2024-02-06T00:43:44.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname 2024-02-06T00:43:44.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2024-02-06T00:43:44.287 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-02-06T00:43:44.339 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-06T00:43:44.339 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Ubuntu" 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="22.04" 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_CODENAME=jammy 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:ID=ubuntu 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE=debian 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-06T00:43:44.340 INFO:teuthology.orchestra.run.smithi001.stdout:UBUNTU_CODENAME=jammy 2024-02-06T00:43:44.340 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2024-02-06T00:43:44.341 DEBUG:teuthology.parallel:result is None 2024-02-06T00:43:47.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:47.726 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-06T00:43:53.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:53.899 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-06T00:43:53.899 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-06T00:43:54.313 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-02-06T00:43:54.313 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-02-06T00:43:54.360 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-02-06T00:43:54.360 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-02-06T00:43:54.408 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-02-06T00:43:54.408 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-02-06T00:43:54.554 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-02-06T00:43:54.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-02-06T00:43:54.618 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-02-06T00:43:54.671 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-02-06T00:43:54.727 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-06T00:43:54.775 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-06T00:43:54.776 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-02-06T00:43:54.777 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-02-06T00:43:54.777 DEBUG:teuthology.parallel:result is None 2024-02-06T00:43:55.028 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2024-02-06T00:43:55.028 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-06T00:43:55.057 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2024-02-06T00:43:55.057 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-06T00:43:55.073 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-02-06T00:43:55.073 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-06T00:43:55.092 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2024-02-06T00:43:55.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-02-06T00:43:55.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:55.175 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-02-06T00:43:55.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-02-06T00:43:55.284 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-02-06T00:43:55.331 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-02-06T00:43:55.331 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-02-06T00:43:55.379 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-06T00:43:55.379 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Ubuntu" 2024-02-06T00:43:55.379 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="22.04" 2024-02-06T00:43:55.379 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-06T00:43:55.379 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_CODENAME=jammy 2024-02-06T00:43:55.379 INFO:teuthology.orchestra.run.smithi001.stdout:ID=ubuntu 2024-02-06T00:43:55.379 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE=debian 2024-02-06T00:43:55.380 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-06T00:43:55.380 INFO:teuthology.orchestra.run.smithi001.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-06T00:43:55.380 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-06T00:43:55.380 INFO:teuthology.orchestra.run.smithi001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-06T00:43:55.380 INFO:teuthology.orchestra.run.smithi001.stdout:UBUNTU_CODENAME=jammy 2024-02-06T00:43:55.380 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-02-06T00:43:55.398 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2024-02-06T00:43:55.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-06T00:43:55.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:55.480 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-02-06T00:43:55.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-06T00:43:55.737 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-02-06T00:43:55.784 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-02-06T00:43:55.784 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-06T00:43:55.832 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-06T00:43:55.833 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2024-02-06T00:43:55.833 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-02-06T00:43:55.858 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-02-06T00:43:55.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-06T00:43:55.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T00:43:55.934 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-02-06T00:43:56.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-06T00:43:56.044 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-02-06T00:43:56.091 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-02-06T00:43:56.092 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-06T00:43:56.140 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-06T00:43:56.141 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-06T00:43:56.141 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-02-06T00:43:56.141 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-06T00:43:56.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:43:56.271 INFO:teuthology.dispatcher.supervisor:Running job 7547244 2024-02-06T00:43:56.271 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-05_16:33:30-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi/7547244 --name yuriw-2024-02-05_16:33:30-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/archive/yuriw-2024-02-05_16:33:30-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi/7547244/orig.config.yaml 2024-02-06T00:43:56.275 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-05_16:33:30-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi/7547244 2024-02-06T00:43:56.275 INFO:teuthology.dispatcher.supervisor:Job PID: 250664 2024-02-06T00:43:56.275 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-06T00:45:56.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:47:56.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:49:56.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:51:56.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:53:56.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:55:57.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:57:57.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T00:59:57.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T01:01:57.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T01:03:57.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T01:05:58.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T01:07:58.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T01:09:58.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T01:09:58.503 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1