2024-04-18T23:59:05.684 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T23:59:05.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:59:05.871 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef78b14c10>, signals=[15]) 2024-04-18T23:59:05.871 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-04-18T23:59:05.871 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:59:05.871 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-18T23:59:05.890 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2024-04-18T23:59:05.890 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:59:05.890 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-18T23:59:05.915 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2024-04-18T23:59:05.915 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:59:05.915 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-18T23:59:06.003 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T23:59:06.035 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T23:59:06.047 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T23:59:06.051 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of ubuntu 22.04 2024-04-18T23:59:06.075 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of ubuntu 22.04 2024-04-18T23:59:06.093 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 22.04 2024-04-18T23:59:06.291 INFO:teuthology.orchestra.console.smithi006:Power off 2024-04-18T23:59:06.291 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:59:06.321 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-04-18T23:59:06.321 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:06.347 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-04-18T23:59:06.354 INFO:teuthology.orchestra.console.smithi098:Power off 2024-04-18T23:59:06.354 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:59:06.367 INFO:teuthology.orchestra.console.smithi059:Power off 2024-04-18T23:59:06.367 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:59:06.375 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-04-18T23:59:06.376 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:06.388 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-04-18T23:59:06.388 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:06.398 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-18T23:59:06.412 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-18T23:59:10.351 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:10.399 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:10.413 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:10.461 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-04-18T23:59:10.507 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-18T23:59:10.521 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-18T23:59:14.462 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:14.509 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:14.522 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:14.572 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T23:59:14.617 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-18T23:59:14.630 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-18T23:59:14.673 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-04-18T23:59:14.718 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-04-18T23:59:14.774 INFO:teuthology.orchestra.console.smithi006:Power on 2024-04-18T23:59:14.775 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:59:14.798 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-04-18T23:59:14.798 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:14.819 INFO:teuthology.orchestra.console.smithi098:Power on 2024-04-18T23:59:14.819 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:59:14.828 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T23:59:14.841 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-04-18T23:59:14.841 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:14.863 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-18T23:59:18.634 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:18.744 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-18T23:59:18.829 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:18.845 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-04-18T23:59:18.864 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:18.940 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T23:59:18.947 INFO:teuthology.orchestra.console.smithi059:Power on 2024-04-18T23:59:18.947 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:59:18.972 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2024-04-18T23:59:18.974 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:18.985 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-18T23:59:19.003 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-18T23:59:19.086 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-04-18T23:59:19.186 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2024-04-18T23:59:22.945 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:23.004 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:59:23.054 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-04-18T23:59:23.114 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-18T23:59:23.155 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-04-18T23:59:23.215 INFO:teuthology.orchestra.console.smithi059:Power on completed 2024-04-18T23:59:23.256 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-04-18T23:59:23.315 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2024-04-19T00:02:24.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:24.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:27.426 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:02:27.427 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T00:02:33.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:33.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:35.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:36.510 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T00:02:36.511 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:02:38.366 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-19T00:02:42.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:42.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:44.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:45.566 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T00:02:45.567 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:02:47.426 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-19T00:02:51.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:51.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:53.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:02:54.654 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T00:02:54.655 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:02:56.510 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-19T00:03:00.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:00.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:02.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:03.714 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T00:03:03.746 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:03:05.566 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-19T00:03:09.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:09.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:11.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:12.802 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:03:12.803 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T00:03:14.622 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-19T00:03:18.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:18.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:20.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:21.886 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:03:23.678 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-19T00:03:27.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:29.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:30.946 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:03:32.734 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-19T00:03:36.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:38.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:40.030 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:03:46.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:49.086 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:03:55.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:03:58.174 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:04:04.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:04:07.230 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:04:13.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:04:16.318 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:04:18.814 WARNING:teuthology.provision.fog.smithi059:timed out 2024-04-19T00:04:22.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:04:24.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:04:31.902 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T00:04:37.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:04:38.173 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T00:04:38.176 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T00:04:38.665 INFO:teuthology.provision.fog.smithi059:Node is ready 2024-04-19T00:04:38.665 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2024-04-19T00:04:38.714 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2024-04-19T00:04:38.715 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2024-04-19T00:04:38.739 WARNING:teuthology.provision.fog.smithi098:timed out 2024-04-19T00:04:38.763 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2024-04-19T00:04:38.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-04-19T00:04:38.887 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2024-04-19T00:04:38.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2024-04-19T00:04:38.959 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2024-04-19T00:04:39.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-04-19T00:04:39.074 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-19T00:04:39.126 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="22.04" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=jammy 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T00:04:39.127 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=jammy 2024-04-19T00:04:39.128 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2024-04-19T00:04:39.130 DEBUG:teuthology.parallel:result is None 2024-04-19T00:04:44.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:04:45.035 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T00:04:45.035 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T00:04:45.489 INFO:teuthology.provision.fog.smithi098:Node is ready 2024-04-19T00:04:45.489 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2024-04-19T00:04:45.535 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2024-04-19T00:04:45.536 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2024-04-19T00:04:45.588 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2024-04-19T00:04:45.588 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-04-19T00:04:45.741 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2024-04-19T00:04:45.755 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2024-04-19T00:04:45.812 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2024-04-19T00:04:45.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-04-19T00:04:45.923 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-19T00:04:45.974 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T00:04:45.975 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2024-04-19T00:04:45.976 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2024-04-19T00:04:45.976 DEBUG:teuthology.parallel:result is None 2024-04-19T00:05:22.360 WARNING:teuthology.provision.fog.smithi006:timed out 2024-04-19T00:05:28.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:05:31.391 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T00:05:37.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:05:37.581 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T00:05:37.581 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T00:05:38.054 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-04-19T00:05:38.055 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-04-19T00:05:38.103 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2024-04-19T00:05:38.104 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2024-04-19T00:05:38.151 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2024-04-19T00:05:38.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-19T00:05:38.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2024-04-19T00:05:38.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2024-04-19T00:05:38.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2024-04-19T00:05:38.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-19T00:05:38.439 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-19T00:05:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T00:05:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2024-04-19T00:05:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2024-04-19T00:05:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T00:05:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2024-04-19T00:05:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2024-04-19T00:05:38.488 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2024-04-19T00:05:38.488 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T00:05:38.488 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T00:05:38.488 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T00:05:38.488 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T00:05:38.488 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2024-04-19T00:05:38.488 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-04-19T00:05:38.489 DEBUG:teuthology.parallel:result is None 2024-04-19T00:05:38.744 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2024-04-19T00:05:38.745 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T00:05:38.770 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2024-04-19T00:05:38.771 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T00:05:38.829 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2024-04-19T00:05:38.829 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T00:05:38.872 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2024-04-19T00:05:38.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-19T00:05:38.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:05:38.953 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-04-19T00:05:39.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-19T00:05:39.053 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-04-19T00:05:39.099 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-04-19T00:05:39.100 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-19T00:05:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T00:05:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2024-04-19T00:05:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T00:05:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2024-04-19T00:05:39.148 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-19T00:05:39.179 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2024-04-19T00:05:39.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-19T00:05:39.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:05:39.266 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-19T00:05:39.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-19T00:05:39.502 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-04-19T00:05:39.549 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-04-19T00:05:39.550 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="22.04" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=jammy 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T00:05:39.598 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=jammy 2024-04-19T00:05:39.599 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-19T00:05:39.620 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2024-04-19T00:05:39.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-19T00:05:39.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:05:39.698 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-04-19T00:05:39.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-19T00:05:39.918 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-04-19T00:05:39.962 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-04-19T00:05:39.963 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T00:05:40.011 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T00:05:40.012 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T00:05:40.012 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2024-04-19T00:05:40.012 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-19T00:05:40.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:05:40.129 INFO:teuthology.dispatcher.supervisor:Running job 7663136 2024-04-19T00:05:40.129 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663136 --name yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi --description rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} -- /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663136/orig.config.yaml 2024-04-19T00:05:40.132 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663136 2024-04-19T00:05:40.132 INFO:teuthology.dispatcher.supervisor:Job PID: 2409776 2024-04-19T00:05:40.132 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-19T00:07:40.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:09:40.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:11:40.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:13:40.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:15:40.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:17:41.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:19:41.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:21:41.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:23:41.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:25:41.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:27:42.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:29:42.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:31:42.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:31:42.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1