2023-11-28T23:16:33.823 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T23:16:33.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:16:33.964 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5540642dc0>, signals=[15]) 2023-11-28T23:16:33.964 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-11-28T23:16:33.965 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T23:16:33.965 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-28T23:16:33.986 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-11-28T23:16:33.987 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T23:16:33.987 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-28T23:16:34.103 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-28T23:16:34.140 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-28T23:16:34.150 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 22.04 2023-11-28T23:16:34.185 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of ubuntu 22.04 2023-11-28T23:16:34.470 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-28T23:16:34.470 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T23:16:34.491 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-28T23:16:34.492 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:34.503 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-28T23:16:34.503 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T23:16:34.516 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-28T23:16:34.523 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-28T23:16:34.523 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:34.545 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-28T23:16:38.521 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:38.547 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:38.630 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-28T23:16:38.655 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-28T23:16:42.632 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:42.656 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:42.741 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-28T23:16:42.764 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T23:16:42.864 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-28T23:16:42.965 INFO:teuthology.orchestra.console.smithi186:Power on 2023-11-28T23:16:42.965 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T23:16:42.988 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-11-28T23:16:42.989 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:43.010 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T23:16:46.744 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:46.854 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-28T23:16:46.955 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-28T23:16:47.011 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:47.056 INFO:teuthology.orchestra.console.smithi033:Power on 2023-11-28T23:16:47.056 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T23:16:47.078 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-11-28T23:16:47.079 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:47.100 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-28T23:16:47.121 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T23:16:51.103 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:51.122 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:16:51.213 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-28T23:16:51.230 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-28T23:16:51.314 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-11-28T23:16:51.331 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-11-28T23:16:51.415 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-11-28T23:16:51.432 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-11-28T23:19:52.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:19:55.458 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:20:01.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:04.514 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:20:07.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:10.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:10.530 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:20:13.574 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:20:16.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:19.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:19.586 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:20:22.662 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:20:25.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:28.646 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:20:28.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:31.718 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:20:34.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:37.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:37.730 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:20:43.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:46.790 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:20:47.970 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:20:52.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:53.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:20:55.874 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:20:57.030 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:21:01.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:03.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:04.934 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:21:06.118 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:21:10.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:12.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:14.022 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:21:15.206 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:21:20.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:21.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:21.210 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:21:27.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:27.219 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:21:33.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:38.402 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:21:40.454 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-28T23:21:44.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:46.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:46.653 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T23:21:46.654 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T23:21:47.126 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-11-28T23:21:47.126 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-11-28T23:21:47.175 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-11-28T23:21:47.176 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-11-28T23:21:47.223 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-11-28T23:21:47.224 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-28T23:21:47.384 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-11-28T23:21:47.399 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-11-28T23:21:47.456 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-11-28T23:21:47.458 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:21:47.511 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-28T23:21:47.565 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-28T23:21:47.611 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:21:47.612 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:21:47.613 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-11-28T23:21:47.614 DEBUG:teuthology.parallel:result is None 2023-11-28T23:21:53.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:53.464 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:21:59.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:21:59.472 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:22:05.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:22:05.480 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:22:11.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:22:11.488 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:22:17.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:22:17.497 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T23:22:23.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:22:23.799 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T23:22:23.799 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T23:22:24.213 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-11-28T23:22:24.213 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-11-28T23:22:24.259 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-11-28T23:22:24.260 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-11-28T23:22:24.308 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-11-28T23:22:24.308 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-28T23:22:24.436 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-11-28T23:22:24.450 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-11-28T23:22:24.511 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-11-28T23:22:24.571 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-28T23:22:24.629 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu" 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="22.04" 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=jammy 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:22:24.679 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:22:24.680 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:22:24.680 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:22:24.680 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-11-28T23:22:24.680 DEBUG:teuthology.parallel:result is None 2023-11-28T23:22:24.858 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-11-28T23:22:24.858 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T23:22:24.884 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-11-28T23:22:24.884 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T23:22:24.910 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-11-28T23:22:24.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-28T23:22:24.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:22:24.988 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-11-28T23:22:25.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-28T23:22:25.242 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-11-28T23:22:25.290 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-11-28T23:22:25.290 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-11-28T23:22:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:22:25.340 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:22:25.340 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:22:25.340 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:22:25.340 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:22:25.340 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-28T23:22:25.359 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-11-28T23:22:25.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-28T23:22:25.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:22:25.436 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-28T23:22:25.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-28T23:22:25.570 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-11-28T23:22:25.617 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-11-28T23:22:25.618 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-28T23:22:25.666 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:22:25.666 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu" 2023-11-28T23:22:25.666 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="22.04" 2023-11-28T23:22:25.666 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=jammy 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:22:25.667 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:22:25.667 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-28T23:22:25.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:22:25.774 INFO:teuthology.dispatcher.supervisor:Running job 7470257 2023-11-28T23:22:25.774 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470257 --name mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470257/orig.config.yaml 2023-11-28T23:22:25.777 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470257 2023-11-28T23:22:25.778 INFO:teuthology.dispatcher.supervisor:Job PID: 4118634 2023-11-28T23:22:25.778 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T23:24:25.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:26:26.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:28:26.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:30:26.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:32:26.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:34:26.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:36:26.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:38:26.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:40:27.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:42:27.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:44:27.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:46:27.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:48:27.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:50:27.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:52:28.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:54:30.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:56:30.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:58:30.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:00:30.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:02:30.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:04:31.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:06:31.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:08:31.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:10:31.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:12:31.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:14:31.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:16:32.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:18:32.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:20:32.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:22:32.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:24:32.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:26:32.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:28:33.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:30:33.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:32:35.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:34:35.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:36:36.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:38:36.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:40:36.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:42:36.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:44:36.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:44:37.008 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-29T00:44:37.167 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-29T00:44:37.168 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T00:44:37.216 DEBUG:teuthology.nuke:shortname: smithi033 2023-11-29T00:44:37.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T00:44:37.238 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470257', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 23:16:32.964693', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvPeKlTg2Qj1ROkDnEi3hp9zeALRYK5RBQdKZ+8VgElxvY5aMJ0tIHGGOBJuhveeVKmGkmvXlU40vON/2fCl50='} 2023-11-29T00:44:37.241 DEBUG:teuthology.nuke:shortname: smithi186 2023-11-29T00:44:37.241 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T00:44:37.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470257', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 23:16:32.966724', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBnKdosv+QaErBKYuqsHpiBWVFWfEXYRfWOghMQw1IKJ3/dCpm7nbJwGawzRuKCViUSxFhF1QQvL5JJSZlV1mKE='} 2023-11-29T00:44:37.296 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-29T00:44:37.297 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T00:44:37.320 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-29T00:44:37.320 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T00:44:37.334 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-29T00:44:37.334 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T00:44:37.341 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-29T00:44:37.354 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-29T00:44:37.354 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T00:44:37.374 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-29T00:44:37.442 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-29T00:44:37.476 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-29T00:44:37.599 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-11-29T00:44:37.626 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com