2023-12-04T05:08:30.638 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T05:08:30.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:08:30.763 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6071b15550>, signals=[15]) 2023-12-04T05:08:30.764 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-12-04T05:08:30.764 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T05:08:30.764 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-12-04T05:08:30.780 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2023-12-04T05:08:30.780 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T05:08:30.780 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2023-12-04T05:08:30.883 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-04T05:08:30.913 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-04T05:08:30.926 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 22.04 2023-12-04T05:08:30.966 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of ubuntu 22.04 2023-12-04T05:08:31.406 INFO:teuthology.orchestra.console.smithi033:Power off 2023-12-04T05:08:31.406 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:08:31.428 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-12-04T05:08:31.428 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:31.451 INFO:teuthology.orchestra.console.smithi076:Power off 2023-12-04T05:08:31.452 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:08:31.459 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-12-04T05:08:31.471 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2023-12-04T05:08:31.471 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:31.495 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-12-04T05:08:35.462 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:35.497 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:35.572 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-12-04T05:08:35.605 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-12-04T05:08:39.578 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:39.606 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:39.689 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-12-04T05:08:39.717 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-04T05:08:39.817 INFO:teuthology.orchestra.console.smithi076:Power off completed 2023-12-04T05:08:39.918 INFO:teuthology.orchestra.console.smithi076:Power on 2023-12-04T05:08:39.918 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T05:08:39.943 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2023-12-04T05:08:39.944 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:39.964 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-04T05:08:43.694 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:43.802 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-12-04T05:08:43.903 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-12-04T05:08:43.965 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:44.003 INFO:teuthology.orchestra.console.smithi033:Power on 2023-12-04T05:08:44.004 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T05:08:44.024 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-12-04T05:08:44.025 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:44.043 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-12-04T05:08:44.074 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-04T05:08:48.048 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:48.075 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:48.157 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-12-04T05:08:48.183 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-12-04T05:08:48.283 INFO:teuthology.orchestra.console.smithi076:Power on completed 2023-12-04T05:08:48.384 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2023-12-04T05:08:52.161 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:52.269 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-12-04T05:08:52.370 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-12-04T05:08:52.470 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-12-04T05:12:56.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:15.363 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:13:21.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:24.418 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:13:30.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:33.506 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:13:39.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:57.858 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:14:03.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:06.914 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:14:12.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:15.970 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:14:21.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:21.975 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:14:27.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:27.985 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:14:33.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:33.994 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:14:39.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:47.267 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-04T05:14:53.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:53.580 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T05:14:53.581 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T05:14:54.128 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-12-04T05:14:54.128 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-12-04T05:14:54.175 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-12-04T05:14:54.175 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-12-04T05:14:54.223 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-12-04T05:14:54.223 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-12-04T05:14:54.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-12-04T05:14:54.361 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-12-04T05:14:54.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-12-04T05:14:54.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-12-04T05:14:54.526 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-12-04T05:14:54.579 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-04T05:14:54.579 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-12-04T05:14:54.579 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-12-04T05:14:54.579 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-04T05:14:54.579 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-12-04T05:14:54.579 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-12-04T05:14:54.580 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-12-04T05:14:54.580 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-04T05:14:54.580 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-04T05:14:54.580 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-04T05:14:54.580 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-04T05:14:54.580 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-12-04T05:14:54.580 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-12-04T05:14:54.581 DEBUG:teuthology.parallel:result is None 2023-12-04T05:18:29.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:32.070 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:18:38.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:41.158 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:18:47.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:50.246 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:18:56.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:59.330 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:19:05.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:08.418 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:19:14.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:17.506 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:19:23.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:26.594 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:19:32.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:35.650 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:19:41.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:00.098 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:20:06.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:09.187 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:20:15.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:17.250 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:20:23.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:23.256 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:20:29.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:29.264 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:20:35.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:35.272 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-04T05:20:41.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:41.614 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T05:20:41.614 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T05:20:42.089 INFO:teuthology.provision.fog.smithi076:Node is ready 2023-12-04T05:20:42.089 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2023-12-04T05:20:42.138 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2023-12-04T05:20:42.138 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2023-12-04T05:20:42.187 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2023-12-04T05:20:42.187 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2023-12-04T05:20:42.295 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2023-12-04T05:20:42.310 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2023-12-04T05:20:42.366 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2023-12-04T05:20:42.421 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2023-12-04T05:20:42.479 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2023-12-04T05:20:42.527 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-04T05:20:42.527 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Ubuntu" 2023-12-04T05:20:42.527 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="22.04" 2023-12-04T05:20:42.527 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-04T05:20:42.527 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_CODENAME=jammy 2023-12-04T05:20:42.528 INFO:teuthology.orchestra.run.smithi076.stdout:ID=ubuntu 2023-12-04T05:20:42.528 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE=debian 2023-12-04T05:20:42.528 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-04T05:20:42.528 INFO:teuthology.orchestra.run.smithi076.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-04T05:20:42.528 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-04T05:20:42.528 INFO:teuthology.orchestra.run.smithi076.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-04T05:20:42.528 INFO:teuthology.orchestra.run.smithi076.stdout:UBUNTU_CODENAME=jammy 2023-12-04T05:20:42.528 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2023-12-04T05:20:42.529 DEBUG:teuthology.parallel:result is None 2023-12-04T05:20:42.742 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-12-04T05:20:42.743 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T05:20:42.774 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2023-12-04T05:20:42.774 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T05:20:42.797 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-12-04T05:20:42.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-12-04T05:20:42.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:42.878 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-12-04T05:20:43.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-12-04T05:20:43.108 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-12-04T05:20:43.162 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-12-04T05:20:43.163 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-12-04T05:20:43.208 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-04T05:20:43.209 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-12-04T05:20:43.210 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-12-04T05:20:43.238 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2023-12-04T05:20:43.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2023-12-04T05:20:43.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:43.315 DEBUG:teuthology.orchestra.run.smithi076:> true 2023-12-04T05:20:43.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2023-12-04T05:20:43.410 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2023-12-04T05:20:43.460 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2023-12-04T05:20:43.460 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2023-12-04T05:20:43.509 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-04T05:20:43.509 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Ubuntu" 2023-12-04T05:20:43.509 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="22.04" 2023-12-04T05:20:43.509 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-04T05:20:43.509 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_CODENAME=jammy 2023-12-04T05:20:43.510 INFO:teuthology.orchestra.run.smithi076.stdout:ID=ubuntu 2023-12-04T05:20:43.510 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE=debian 2023-12-04T05:20:43.510 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-04T05:20:43.510 INFO:teuthology.orchestra.run.smithi076.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-04T05:20:43.510 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-04T05:20:43.510 INFO:teuthology.orchestra.run.smithi076.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-04T05:20:43.510 INFO:teuthology.orchestra.run.smithi076.stdout:UBUNTU_CODENAME=jammy 2023-12-04T05:20:43.510 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2023-12-04T05:20:43.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:20:43.629 INFO:teuthology.dispatcher.supervisor:Running job 7476653 2023-12-04T05:20:43.629 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476653 --name vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476653/orig.config.yaml 2023-12-04T05:20:43.644 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476653 2023-12-04T05:20:43.645 INFO:teuthology.dispatcher.supervisor:Job PID: 3991435 2023-12-04T05:20:43.645 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-04T05:22:43.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:24:43.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:26:44.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:28:44.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:30:44.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:32:44.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:34:44.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:36:44.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:38:45.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:40:45.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:42:45.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:44:45.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:46:45.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:48:45.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:50:46.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:52:46.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:54:46.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:56:46.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:58:46.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T06:00:46.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T06:00:46.960 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-04T06:00:47.069 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-04T06:00:47.069 INFO:teuthology.nuke:Checking targets against current locks 2023-12-04T06:00:47.120 DEBUG:teuthology.nuke:shortname: smithi033 2023-12-04T06:00:47.120 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T06:00:47.142 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:29.854012', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdsnwsKwu1NjEFrz0l/RutIfzEjQhF0aaoBEpH4x9W3f18c4WjTX+ZzYnpplndm5erwWQ48xKwSbXd6svGubAw='} 2023-12-04T06:00:47.145 DEBUG:teuthology.nuke:shortname: smithi076 2023-12-04T06:00:47.145 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T06:00:47.167 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:29.855639', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFp7mNGq5YZ+O/ikNIzumvI1wDdnLS+SxLsNZd1bE4+HhgaLCCnnhlRd7z+WTXOPp1BS/bwB62Ytm9WlAcHHEw='} 2023-12-04T06:00:47.193 INFO:teuthology.orchestra.console.smithi033:Power off 2023-12-04T06:00:47.193 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T06:00:47.207 INFO:teuthology.orchestra.console.smithi076:Power off 2023-12-04T06:00:47.207 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T06:00:47.215 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-12-04T06:00:47.215 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T06:00:47.231 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2023-12-04T06:00:47.231 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T06:00:47.239 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-12-04T06:00:47.253 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-04T06:00:47.340 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-12-04T06:00:47.353 INFO:teuthology.orchestra.console.smithi076:Power off completed 2023-12-04T06:00:47.494 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-12-04T06:00:47.502 INFO:teuthology.lock.ops:unlocked: smithi076.front.sepia.ceph.com