2024-04-15T12:27:07.855 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T12:27:07.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:27:08.034 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff9aa86bc10>, signals=[15]) 2024-04-15T12:27:08.035 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2024-04-15T12:27:08.035 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T12:27:08.035 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-15T12:27:08.069 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2024-04-15T12:27:08.069 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T12:27:08.069 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-15T12:27:08.093 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2024-04-15T12:27:08.093 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T12:27:08.093 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-15T12:27:08.199 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-15T12:27:08.210 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-15T12:27:08.228 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-15T12:27:08.241 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 22.04 2024-04-15T12:27:08.249 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of ubuntu 22.04 2024-04-15T12:27:08.277 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 22.04 2024-04-15T12:27:08.468 INFO:teuthology.orchestra.console.smithi111:Power off 2024-04-15T12:27:08.468 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T12:27:08.482 INFO:teuthology.orchestra.console.smithi121:Power off 2024-04-15T12:27:08.482 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T12:27:08.491 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-04-15T12:27:08.492 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:08.503 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2024-04-15T12:27:08.504 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:08.514 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-15T12:27:08.526 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-15T12:27:08.568 INFO:teuthology.orchestra.console.smithi169:Power off 2024-04-15T12:27:08.569 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T12:27:08.590 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-04-15T12:27:08.590 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:08.615 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-15T12:27:12.518 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:12.527 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:12.616 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:12.628 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-15T12:27:12.635 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-15T12:27:12.726 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-15T12:27:16.630 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:16.638 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:16.727 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:16.740 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-15T12:27:16.747 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-15T12:27:16.837 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-04-15T12:27:16.841 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-04-15T12:27:16.938 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-04-15T12:27:16.942 INFO:teuthology.orchestra.console.smithi111:Power on 2024-04-15T12:27:16.942 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T12:27:16.962 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2024-04-15T12:27:16.962 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:16.985 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-15T12:27:17.039 INFO:teuthology.orchestra.console.smithi169:Power on 2024-04-15T12:27:17.039 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T12:27:17.064 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2024-04-15T12:27:17.064 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:17.087 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-04-15T12:27:20.751 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:20.861 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-15T12:27:20.961 INFO:teuthology.orchestra.console.smithi121:Power off completed 2024-04-15T12:27:20.986 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:21.062 INFO:teuthology.orchestra.console.smithi121:Power on 2024-04-15T12:27:21.063 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T12:27:21.085 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2024-04-15T12:27:21.085 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:21.092 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:21.101 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-15T12:27:21.106 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-15T12:27:21.202 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-04-15T12:27:25.106 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:25.113 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:25.203 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T12:27:25.215 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-15T12:27:25.222 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-15T12:27:25.312 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-15T12:27:25.316 INFO:teuthology.orchestra.console.smithi111:Power on completed 2024-04-15T12:27:25.323 INFO:teuthology.orchestra.console.smithi121:Power on completed 2024-04-15T12:27:25.413 INFO:teuthology.orchestra.console.smithi169:Power on completed 2024-04-15T12:27:25.418 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2024-04-15T12:27:25.423 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2024-04-15T12:27:25.514 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2024-04-15T12:30:41.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:30:41.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:30:44.802 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:30:44.803 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:30:50.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:30:50.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:30:53.886 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:30:53.887 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:30:56.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:30:59.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:30:59.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:30:59.902 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-15T12:31:02.942 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:31:02.943 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:31:05.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:08.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:08.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:08.958 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-15T12:31:11.998 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:31:11.999 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:31:14.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:18.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:18.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:18.014 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-15T12:31:21.054 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:31:21.086 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:31:24.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:27.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:27.070 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-15T12:31:27.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:30.114 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:31:30.142 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:31:33.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:36.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:36.130 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-15T12:31:36.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:39.202 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:31:42.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:45.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:45.214 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-15T12:31:51.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:31:54.274 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-15T12:32:00.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:07.711 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:32:13.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:13.721 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:32:16.671 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:32:19.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:19.725 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:32:22.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:22.676 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:32:25.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:25.732 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-15T12:32:28.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:28.680 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:32:31.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:32.120 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T12:32:32.121 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T12:32:32.799 INFO:teuthology.provision.fog.smithi121:Node is ready 2024-04-15T12:32:32.799 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2024-04-15T12:32:32.846 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2024-04-15T12:32:32.847 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2024-04-15T12:32:32.895 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2024-04-15T12:32:32.895 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-04-15T12:32:33.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2024-04-15T12:32:33.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2024-04-15T12:32:33.086 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2024-04-15T12:32:33.146 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-04-15T12:32:33.205 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04" 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T12:32:33.250 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T12:32:33.251 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T12:32:33.251 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T12:32:33.251 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy 2024-04-15T12:32:33.251 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2024-04-15T12:32:33.253 DEBUG:teuthology.parallel:result is None 2024-04-15T12:32:34.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:34.685 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-15T12:32:40.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:32:40.902 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T12:32:40.902 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T12:32:41.337 INFO:teuthology.provision.fog.smithi169:Node is ready 2024-04-15T12:32:41.337 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2024-04-15T12:32:41.385 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2024-04-15T12:32:41.385 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2024-04-15T12:32:41.432 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2024-04-15T12:32:41.433 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-04-15T12:32:41.543 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2024-04-15T12:32:41.558 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2024-04-15T12:32:41.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2024-04-15T12:32:41.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-04-15T12:32:41.724 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-15T12:32:41.772 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T12:32:41.772 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-04-15T12:32:41.772 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-04-15T12:32:41.772 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T12:32:41.772 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-04-15T12:32:41.773 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-04-15T12:32:41.773 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-04-15T12:32:41.773 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T12:32:41.773 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T12:32:41.773 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T12:32:41.773 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T12:32:41.773 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-04-15T12:32:41.773 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2024-04-15T12:32:41.773 DEBUG:teuthology.parallel:result is None 2024-04-15T12:33:00.282 WARNING:teuthology.provision.fog.smithi111:timed out 2024-04-15T12:33:06.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:33:06.759 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T12:33:06.759 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T12:33:07.232 INFO:teuthology.provision.fog.smithi111:Node is ready 2024-04-15T12:33:07.232 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2024-04-15T12:33:07.279 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2024-04-15T12:33:07.279 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2024-04-15T12:33:07.328 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2024-04-15T12:33:07.328 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-04-15T12:33:07.518 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2024-04-15T12:33:07.530 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2024-04-15T12:33:07.581 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2024-04-15T12:33:07.634 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-04-15T12:33:07.685 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T12:33:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T12:33:07.736 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T12:33:07.736 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T12:33:07.736 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-04-15T12:33:07.736 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2024-04-15T12:33:07.737 DEBUG:teuthology.parallel:result is None 2024-04-15T12:33:07.970 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2024-04-15T12:33:07.970 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T12:33:07.994 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2024-04-15T12:33:07.994 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T12:33:08.010 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2024-04-15T12:33:08.010 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T12:33:08.028 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2024-04-15T12:33:08.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-15T12:33:08.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:33:08.108 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-15T12:33:08.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-15T12:33:08.202 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-04-15T12:33:08.247 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-04-15T12:33:08.247 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-15T12:33:08.294 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T12:33:08.295 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-04-15T12:33:08.296 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-15T12:33:08.319 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2024-04-15T12:33:08.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-15T12:33:08.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:33:08.400 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-04-15T12:33:08.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-15T12:33:08.646 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-04-15T12:33:08.693 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-04-15T12:33:08.693 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04" 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2024-04-15T12:33:08.742 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T12:33:08.743 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T12:33:08.743 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T12:33:08.743 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T12:33:08.743 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy 2024-04-15T12:33:08.743 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-15T12:33:08.769 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2024-04-15T12:33:08.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-15T12:33:08.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T12:33:08.849 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-15T12:33:08.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-15T12:33:08.974 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-04-15T12:33:09.023 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-04-15T12:33:09.023 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-15T12:33:09.071 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T12:33:09.072 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-04-15T12:33:09.073 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-15T12:33:09.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:33:09.188 INFO:teuthology.dispatcher.supervisor:Running job 7644243 2024-04-15T12:33:09.188 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi/7644243 --name teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi --description rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_rgw_multisite} -- /home/teuthworker/archive/teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi/7644243/orig.config.yaml 2024-04-15T12:33:09.191 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi/7644243 2024-04-15T12:33:09.191 INFO:teuthology.dispatcher.supervisor:Job PID: 2179183 2024-04-15T12:33:09.191 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-15T12:35:09.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:37:09.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:39:09.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:41:09.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:43:10.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:45:10.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:47:10.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:49:10.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:51:10.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:53:10.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:55:11.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:57:11.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T12:57:11.292 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1