2023-11-12T09:57:54.268 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-12T09:57:54.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:57:54.401 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f223724eb80>, signals=[15]) 2023-11-12T09:57:54.403 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2023-11-12T09:57:54.403 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2023-11-12T09:57:54.403 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-11-12T09:57:54.428 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-11-12T09:57:54.428 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-11-12T09:57:54.429 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-11-12T09:57:54.430 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"} 2023-11-12T09:57:54.452 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-11-12T09:57:54.505 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-12T09:57:54.509 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-12T09:57:54.544 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-12T09:57:54.544 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 6} 2023-11-12T09:57:54.558 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-12T09:57:54.558 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 6} 2023-11-12T09:57:54.589 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of ubuntu 22.04 2023-11-12T09:57:54.589 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:57:54.609 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 22.04 2023-11-12T09:57:54.609 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:57:54.698 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"} 2023-11-12T09:57:54.703 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-11-12T09:57:54.733 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1} 2023-11-12T09:57:54.736 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-11-12T09:57:54.785 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:57:54.787 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:57:54.931 INFO:teuthology.orchestra.console.smithi050:Power off 2023-11-12T09:57:54.932 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T09:57:54.942 INFO:teuthology.orchestra.console.smithi149:Power off 2023-11-12T09:57:54.942 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T09:57:54.952 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-11-12T09:57:54.952 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:57:54.963 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-11-12T09:57:54.964 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:57:54.973 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-11-12T09:57:54.985 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-11-12T09:57:58.979 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:57:58.987 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:57:59.089 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-11-12T09:57:59.097 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-11-12T09:58:03.094 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:03.103 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:03.206 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-11-12T09:58:03.213 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-11-12T09:58:03.307 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-11-12T09:58:03.315 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-11-12T09:58:03.409 INFO:teuthology.orchestra.console.smithi050:Power on 2023-11-12T09:58:03.409 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-12T09:58:03.419 INFO:teuthology.orchestra.console.smithi149:Power on 2023-11-12T09:58:03.419 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-12T09:58:03.434 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On 2023-11-12T09:58:03.434 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:03.443 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2023-11-12T09:58:03.444 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:03.458 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-11-12T09:58:03.468 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-11-12T09:58:07.464 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:07.473 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:07.575 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-11-12T09:58:07.582 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-11-12T09:58:11.577 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:11.583 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:58:11.685 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-11-12T09:58:11.691 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-11-12T09:58:11.787 INFO:teuthology.orchestra.console.smithi050:Power on completed 2023-11-12T09:58:11.793 INFO:teuthology.orchestra.console.smithi149:Power on completed 2023-11-12T09:58:11.889 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2023-11-12T09:58:11.889 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:58:11.894 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-11-12T09:58:11.894 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:58:27.007 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:58:27.008 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:58:42.118 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:58:42.119 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:58:57.240 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:58:57.242 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:59:12.359 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:59:12.363 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:59:27.468 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:59:27.474 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:59:42.600 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:59:42.601 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T09:59:57.754 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T09:59:57.756 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:00:12.909 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:00:12.911 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T10:00:28.068 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T10:00:28.070 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:00:43.203 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:00:43.205 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T10:00:58.326 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T10:00:58.328 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:01:13.460 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:01:13.461 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-11-12T10:01:13.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:01:13.646 ERROR:teuthology.orchestra.connection:Error authenticating with smithi050.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-12T10:01:27.930 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-11-12T10:01:28.550 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:01:33.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:01:36.986 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-11-12T10:01:42.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:01:43.640 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:01:46.042 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-11-12T10:01:52.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:01:55.098 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-11-12T10:01:58.716 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:02:01.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:02:04.154 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-11-12T10:02:10.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:02:13.777 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-11-12T10:02:13.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:02:32.186 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-11-12T10:02:38.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:02:41.242 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-11-12T10:02:47.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:02:50.298 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-11-12T10:02:56.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:02:59.354 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-11-12T10:03:05.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:03:10.160 WARNING:teuthology.provision.fog.smithi050:timed out 2023-11-12T10:03:16.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:03:16.359 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-12T10:03:16.363 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-12T10:03:16.841 INFO:teuthology.provision.fog.smithi050:Node is ready 2023-11-12T10:03:16.842 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2023-11-12T10:03:16.889 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2023-11-12T10:03:16.889 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2023-11-12T10:03:16.937 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2023-11-12T10:03:16.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-11-12T10:03:17.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2023-11-12T10:03:17.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2023-11-12T10:03:17.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2023-11-12T10:03:17.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-11-12T10:03:17.240 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-11-12T10:03:17.289 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-12T10:03:17.289 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2023-11-12T10:03:17.289 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2023-11-12T10:03:17.290 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-12T10:03:17.290 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2023-11-12T10:03:17.290 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2023-11-12T10:03:17.290 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2023-11-12T10:03:17.291 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-12T10:03:17.291 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-12T10:03:17.291 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-12T10:03:17.291 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-12T10:03:17.292 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2023-11-12T10:03:17.292 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2023-11-12T10:03:17.294 DEBUG:teuthology.parallel:result is None 2023-11-12T10:04:05.362 WARNING:teuthology.provision.fog.smithi149:timed out 2023-11-12T10:04:11.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:04:11.579 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-12T10:04:11.580 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-12T10:04:12.066 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-11-12T10:04:12.067 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-11-12T10:04:12.112 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-11-12T10:04:12.113 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-11-12T10:04:12.161 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-11-12T10:04:12.161 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-11-12T10:04:12.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-11-12T10:04:12.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-11-12T10:04:12.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-11-12T10:04:12.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-11-12T10:04:12.483 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-11-12T10:04:12.532 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-12T10:04:12.533 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-11-12T10:04:12.533 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="22.04" 2023-11-12T10:04:12.533 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-12T10:04:12.533 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=jammy 2023-11-12T10:04:12.533 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-11-12T10:04:12.534 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-11-12T10:04:12.534 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-12T10:04:12.534 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-12T10:04:12.534 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-12T10:04:12.534 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-12T10:04:12.535 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=jammy 2023-11-12T10:04:12.535 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-11-12T10:04:12.536 DEBUG:teuthology.parallel:result is None 2023-11-12T10:04:12.767 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2023-11-12T10:04:12.767 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-12T10:04:12.792 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-11-12T10:04:12.792 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-12T10:04:12.809 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2023-11-12T10:04:12.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-12T10:04:12.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:04:12.883 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-11-12T10:04:13.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-12T10:04:13.130 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-11-12T10:04:13.179 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-11-12T10:04:13.179 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-11-12T10:04:13.227 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-12T10:04:13.227 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2023-11-12T10:04:13.228 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2023-11-12T10:04:13.228 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-12T10:04:13.228 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2023-11-12T10:04:13.228 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2023-11-12T10:04:13.228 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2023-11-12T10:04:13.229 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-12T10:04:13.229 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-12T10:04:13.229 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-12T10:04:13.229 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-12T10:04:13.230 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2023-11-12T10:04:13.230 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-11-12T10:04:13.259 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-11-12T10:04:13.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-11-12T10:04:13.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T10:04:13.335 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-11-12T10:04:13.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-11-12T10:04:13.430 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-11-12T10:04:13.476 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-11-12T10:04:13.476 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-11-12T10:04:13.524 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-12T10:04:13.525 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-11-12T10:04:13.525 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="22.04" 2023-11-12T10:04:13.525 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-12T10:04:13.525 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=jammy 2023-11-12T10:04:13.525 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-11-12T10:04:13.526 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-11-12T10:04:13.526 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-12T10:04:13.529 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-12T10:04:13.530 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-12T10:04:13.530 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-12T10:04:13.530 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=jammy 2023-11-12T10:04:13.530 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-11-12T10:04:13.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:04:13.631 INFO:teuthology.dispatcher.supervisor:Running job 7456045 2023-11-12T10:04:13.631 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-11-12_09:56:54-rados:thrash-dedup-main-distro-default-smithi/7456045 --name nmordech-2023-11-12_09:56:54-rados:thrash-dedup-main-distro-default-smithi --description rados:thrash-dedup/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/nmordech-2023-11-12_09:56:54-rados:thrash-dedup-main-distro-default-smithi/7456045/orig.config.yaml 2023-11-12T10:04:13.634 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-11-12_09:56:54-rados:thrash-dedup-main-distro-default-smithi/7456045 2023-11-12T10:04:13.635 INFO:teuthology.dispatcher.supervisor:Job PID: 2062438 2023-11-12T10:04:13.635 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-12T10:06:13.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:08:13.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:10:13.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:12:13.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:14:13.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:16:13.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:18:14.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:20:14.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:22:14.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:24:14.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:26:14.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:28:14.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:30:14.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:32:14.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:34:14.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:36:14.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:38:14.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T10:38:14.812 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-12T10:38:14.939 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-12T10:38:14.939 INFO:teuthology.nuke:Checking targets against current locks 2023-11-12T10:38:14.991 DEBUG:teuthology.nuke:shortname: smithi050 2023-11-12T10:38:14.991 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-12T10:38:15.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-12_09:56:54-rados:thrash-dedup-main-distro-default-smithi/7456045', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-12 09:57:53.361573', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK1lO0dPIc0nqn2q0J3dKFj/3AMDkRS5YPEH0mic9XwwlV7PVl5dy08diJa1ws1Zy0MEsplLRnEqM8DvNuGzZoM='} 2023-11-12T10:38:15.015 DEBUG:teuthology.nuke:shortname: smithi149 2023-11-12T10:38:15.015 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-12T10:38:15.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-12_09:56:54-rados:thrash-dedup-main-distro-default-smithi/7456045', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-12 09:57:53.362988', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAzHJZFfti/1ag4z38+3OQ/fSkyMuyCjjFM6lmsfYWokyigbqMxekiBaaLqogvVNvJHHFBGQa2nFC69mieql82M='} 2023-11-12T10:38:15.055 INFO:teuthology.orchestra.console.smithi050:Power off 2023-11-12T10:38:15.056 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T10:38:15.082 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-11-12T10:38:15.082 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T10:38:15.096 INFO:teuthology.orchestra.console.smithi149:Power off 2023-11-12T10:38:15.097 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T10:38:15.107 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-11-12T10:38:15.120 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-11-12T10:38:15.120 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T10:38:15.140 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-11-12T10:38:15.209 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-11-12T10:38:15.242 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-11-12T10:38:15.361 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2023-11-12T10:38:15.395 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com