2023-09-07T05:46:09.807 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-07T05:46:09.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T05:46:09.932 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb76ba83670>, signals=[15]) 2023-09-07T05:46:09.933 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-09-07T05:46:09.933 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-09-07T05:46:09.934 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-09-07T05:46:09.954 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-09-07T05:46:09.954 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-09-07T05:46:09.954 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-09-07T05:46:09.956 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-09-07T05:46:09.979 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-09-07T05:46:10.045 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-07T05:46:10.107 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-07T05:46:10.107 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 6} 2023-09-07T05:46:10.129 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-07T05:46:10.166 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of ubuntu 22.04 2023-09-07T05:46:10.167 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:46:10.183 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-07T05:46:10.184 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 6} 2023-09-07T05:46:10.250 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 22.04 2023-09-07T05:46:10.251 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:46:10.539 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-09-07T05:46:10.585 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-09-07T05:46:10.657 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-09-07T05:46:10.661 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:46:10.707 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-09-07T05:46:10.776 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:46:11.168 INFO:teuthology.orchestra.console.smithi088:Power off 2023-09-07T05:46:11.168 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T05:46:11.189 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-09-07T05:46:11.189 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:11.209 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-09-07T05:46:11.292 INFO:teuthology.orchestra.console.smithi161:Power off 2023-09-07T05:46:11.293 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T05:46:11.314 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-09-07T05:46:11.314 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:11.336 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-09-07T05:46:15.214 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:15.323 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-09-07T05:46:15.337 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:15.445 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-09-07T05:46:19.328 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:19.438 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-09-07T05:46:19.447 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:19.556 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-09-07T05:46:23.444 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:23.554 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-09-07T05:46:23.557 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:23.656 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-09-07T05:46:23.667 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-09-07T05:46:23.757 INFO:teuthology.orchestra.console.smithi088:Power on 2023-09-07T05:46:23.757 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-07T05:46:23.770 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-09-07T05:46:23.780 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2023-09-07T05:46:23.780 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:23.800 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-09-07T05:46:23.872 INFO:teuthology.orchestra.console.smithi161:Power on 2023-09-07T05:46:23.873 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-07T05:46:23.893 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-09-07T05:46:23.893 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:23.914 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-09-07T05:46:27.803 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:27.911 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-09-07T05:46:27.915 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:28.013 INFO:teuthology.orchestra.console.smithi088:Power on completed 2023-09-07T05:46:28.024 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-09-07T05:46:28.114 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-09-07T05:46:28.114 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:46:28.125 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-09-07T05:46:28.226 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-09-07T05:46:28.226 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:46:43.336 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:46:43.458 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:46:58.567 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:46:58.666 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:47:13.808 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:47:13.878 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:47:29.055 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:47:29.145 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:47:44.384 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:47:44.428 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:47:59.877 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:47:59.913 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:48:15.768 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:48:15.955 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:48:31.345 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:48:31.351 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:48:47.009 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:48:47.011 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:49:02.412 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:49:02.415 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:49:17.850 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:49:17.851 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:49:33.201 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:49:33.207 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:49:48.534 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:49:48.549 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:50:03.858 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:50:03.876 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:50:19.090 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-09-07T05:50:19.128 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:50:19.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:50:22.490 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-07T05:50:28.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:50:31.578 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-07T05:50:34.469 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:50:37.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:50:40.634 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-07T05:50:46.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:50:49.722 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-07T05:50:49.748 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:50:55.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:50:58.810 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-07T05:51:04.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:51:05.021 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:51:07.902 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-07T05:51:13.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:51:20.300 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:51:35.571 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:51:50.801 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:52:05.994 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:52:13.918 WARNING:teuthology.provision.fog.smithi161:timed out 2023-09-07T05:52:19.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:52:20.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-07T05:52:20.137 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-07T05:52:20.643 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-09-07T05:52:20.644 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-09-07T05:52:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-09-07T05:52:20.691 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-09-07T05:52:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-09-07T05:52:20.741 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-09-07T05:52:20.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-09-07T05:52:20.906 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-09-07T05:52:20.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-09-07T05:52:21.015 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-09-07T05:52:21.075 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-09-07T05:52:21.127 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-07T05:52:21.127 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-09-07T05:52:21.128 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2023-09-07T05:52:21.128 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-07T05:52:21.128 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2023-09-07T05:52:21.128 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-09-07T05:52:21.128 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-09-07T05:52:21.129 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-07T05:52:21.129 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-07T05:52:21.129 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-07T05:52:21.129 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-07T05:52:21.129 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2023-09-07T05:52:21.130 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-09-07T05:52:21.131 DEBUG:teuthology.parallel:result is None 2023-09-07T05:52:21.194 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-09-07T05:52:21.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:52:24.442 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-09-07T05:52:30.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:52:33.498 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-09-07T05:52:39.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:52:42.586 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-09-07T05:52:48.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:52:51.642 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-09-07T05:52:57.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:53:00.698 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-09-07T05:53:06.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:53:09.786 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-09-07T05:53:15.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:53:18.874 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-09-07T05:53:24.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:24.925 WARNING:teuthology.provision.fog.smithi088:timed out 2023-09-07T05:54:30.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:31.113 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-07T05:54:31.113 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-07T05:54:31.545 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-09-07T05:54:31.545 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-09-07T05:54:31.592 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-09-07T05:54:31.592 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-09-07T05:54:31.644 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-09-07T05:54:31.644 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-09-07T05:54:31.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-09-07T05:54:31.788 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-09-07T05:54:31.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-09-07T05:54:31.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-09-07T05:54:31.959 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-09-07T05:54:32.004 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-07T05:54:32.004 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-09-07T05:54:32.004 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2023-09-07T05:54:32.004 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-07T05:54:32.004 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2023-09-07T05:54:32.005 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-09-07T05:54:32.005 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-09-07T05:54:32.005 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-07T05:54:32.005 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-07T05:54:32.005 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-07T05:54:32.006 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-07T05:54:32.006 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2023-09-07T05:54:32.006 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-09-07T05:54:32.007 DEBUG:teuthology.parallel:result is None 2023-09-07T05:54:32.180 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-09-07T05:54:32.181 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-07T05:54:32.200 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-09-07T05:54:32.200 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-07T05:54:32.217 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-09-07T05:54:32.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-09-07T05:54:32.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:32.293 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-09-07T05:54:32.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-09-07T05:54:32.398 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-09-07T05:54:32.444 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-09-07T05:54:32.444 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-09-07T05:54:32.492 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-07T05:54:32.492 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-09-07T05:54:32.492 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2023-09-07T05:54:32.492 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-07T05:54:32.493 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2023-09-07T05:54:32.493 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-09-07T05:54:32.493 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-09-07T05:54:32.493 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-07T05:54:32.493 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-07T05:54:32.494 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-07T05:54:32.494 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-07T05:54:32.494 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2023-09-07T05:54:32.494 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-09-07T05:54:32.517 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-09-07T05:54:32.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-07T05:54:32.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:32.592 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-09-07T05:54:32.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-07T05:54:32.839 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-09-07T05:54:32.885 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-09-07T05:54:32.885 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-09-07T05:54:32.933 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-07T05:54:32.934 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-09-07T05:54:32.934 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2023-09-07T05:54:32.934 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-07T05:54:32.934 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2023-09-07T05:54:32.934 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-09-07T05:54:32.935 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-09-07T05:54:32.935 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-07T05:54:32.935 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-07T05:54:32.935 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-07T05:54:32.935 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-07T05:54:32.936 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2023-09-07T05:54:32.936 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-09-07T05:54:32.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T05:54:33.047 INFO:teuthology.dispatcher.supervisor:Running job 7390556 2023-09-07T05:54:33.048 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390556 --name vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390556/orig.config.yaml 2023-09-07T05:54:33.050 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390556 2023-09-07T05:54:33.051 INFO:teuthology.dispatcher.supervisor:Job PID: 1055428 2023-09-07T05:54:33.052 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-07T05:56:33.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T05:58:33.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:00:33.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:02:33.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:04:33.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:06:33.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:08:34.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:10:34.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:12:34.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:14:34.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:16:34.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:18:34.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:20:35.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:22:35.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:24:35.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:26:35.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:28:35.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:30:35.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:32:36.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:34:36.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:36:36.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:38:36.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:40:36.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:40:36.908 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-07T06:40:37.016 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-07T06:40:37.017 INFO:teuthology.nuke:Checking targets against current locks 2023-09-07T06:40:37.060 DEBUG:teuthology.nuke:shortname: smithi088 2023-09-07T06:40:37.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-07T06:40:37.083 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390556', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-07 05:46:09.055195', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjgrLYHgqTZXwFOqM78NlFU9A7//zIUp7QCe5npyE7wue6k36lXAt9szDamk5DMuIvvOII0vPGKzEcDBGy0jnY='} 2023-09-07T06:40:37.086 DEBUG:teuthology.nuke:shortname: smithi161 2023-09-07T06:40:37.086 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-07T06:40:37.108 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390556', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-07 05:46:09.053385', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxcknHEA0p+x3HdhOYErZHk7FYWQ0eTr+MJsVicvQQMNXEwRUeJYEEqa2xH41mOwWEJz1u9MRQrP68/m6D7bHU='} 2023-09-07T06:40:37.136 INFO:teuthology.orchestra.console.smithi088:Power off 2023-09-07T06:40:37.136 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T06:40:37.153 INFO:teuthology.orchestra.console.smithi161:Power off 2023-09-07T06:40:37.154 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T06:40:37.162 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-09-07T06:40:37.162 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T06:40:37.174 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-09-07T06:40:37.175 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T06:40:37.182 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-09-07T06:40:37.198 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-09-07T06:40:37.284 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-09-07T06:40:37.299 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-09-07T06:40:37.432 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-09-07T06:40:37.439 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com