2023-10-21T20:58:00.936 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T20:58:00.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:58:01.068 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f47feec6c10>, signals=[15]) 2023-10-21T20:58:01.069 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-10-21T20:58:01.069 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T20:58:01.070 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-21T20:58:01.091 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-10-21T20:58:01.091 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T20:58:01.091 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-21T20:58:01.092 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-10-21T20:58:01.116 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-10-21T20:58:01.162 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-21T20:58:01.191 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-21T20:58:01.199 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-21T20:58:01.200 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 6} 2023-10-21T20:58:01.228 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-21T20:58:01.228 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 6} 2023-10-21T20:58:01.248 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of ubuntu 22.04 2023-10-21T20:58:01.248 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:58:01.273 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of ubuntu 22.04 2023-10-21T20:58:01.273 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:58:01.304 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T20:58:01.319 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T20:58:01.350 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-10-21T20:58:01.368 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-10-21T20:58:01.399 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:58:01.411 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:58:01.484 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-21T20:58:01.485 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T20:58:01.497 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-21T20:58:01.498 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T20:58:01.506 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-21T20:58:01.507 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:01.520 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-21T20:58:01.521 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:01.530 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-21T20:58:01.542 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-21T20:58:05.534 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:05.543 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:05.643 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-21T20:58:05.651 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-21T20:58:09.646 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:09.654 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:09.756 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-21T20:58:09.762 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-21T20:58:09.858 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-21T20:58:09.863 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-21T20:58:09.959 INFO:teuthology.orchestra.console.smithi179:Power on 2023-10-21T20:58:09.960 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T20:58:09.967 INFO:teuthology.orchestra.console.smithi032:Power on 2023-10-21T20:58:09.967 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T20:58:09.980 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-10-21T20:58:09.981 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:09.988 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2023-10-21T20:58:09.989 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:10.000 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-21T20:58:10.008 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-21T20:58:14.004 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:14.010 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:14.112 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-21T20:58:14.120 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-21T20:58:18.118 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:18.125 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:58:18.234 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-21T20:58:18.320 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-21T20:58:18.335 INFO:teuthology.orchestra.console.smithi032:Power on completed 2023-10-21T20:58:18.422 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-10-21T20:58:18.437 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-10-21T20:58:18.437 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:58:18.523 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-10-21T20:58:18.523 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:58:33.511 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:58:33.578 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:58:48.583 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:58:48.633 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:59:03.654 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:59:03.686 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:59:18.726 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:59:18.737 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:59:33.807 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T20:59:33.809 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:59:48.878 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T20:59:48.879 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:00:03.960 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T21:00:03.962 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:00:19.040 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:00:19.041 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T21:00:34.114 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T21:00:34.116 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:00:49.182 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:00:49.184 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T21:01:04.250 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T21:01:04.252 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:01:19.314 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T21:01:19.316 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:01:34.378 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-21T21:01:34.380 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:01:34.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:01:49.446 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:01:52.890 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-21T21:01:58.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:02:01.978 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-21T21:02:04.499 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:02:07.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:02:11.038 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-21T21:02:17.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:02:19.557 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-21T21:02:19.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:02:20.122 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-21T21:02:26.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:02:37.946 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:02:43.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:02:47.002 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:02:53.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:02:56.062 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:03:02.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:03:20.442 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:03:26.134 WARNING:teuthology.provision.fog.smithi179:timed out 2023-10-21T21:03:26.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:03:29.498 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:03:32.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:03:32.361 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T21:03:32.362 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T21:03:32.861 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-10-21T21:03:32.861 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-10-21T21:03:32.907 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2023-10-21T21:03:32.908 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2023-10-21T21:03:32.955 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-10-21T21:03:32.956 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-21T21:03:33.073 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2023-10-21T21:03:33.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-10-21T21:03:33.143 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2023-10-21T21:03:33.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-21T21:03:33.254 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-21T21:03:33.299 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-21T21:03:33.300 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2023-10-21T21:03:33.300 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2023-10-21T21:03:33.300 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-21T21:03:33.300 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2023-10-21T21:03:33.300 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2023-10-21T21:03:33.301 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2023-10-21T21:03:33.301 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T21:03:33.301 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T21:03:33.301 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T21:03:33.301 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T21:03:33.302 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2023-10-21T21:03:33.302 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-10-21T21:03:33.304 DEBUG:teuthology.parallel:result is None 2023-10-21T21:03:35.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:03:38.558 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:03:44.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:03:44.565 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:03:50.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:03:50.574 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:03:56.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:04:11.902 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-21T21:04:17.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:04:18.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T21:04:18.118 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T21:04:18.687 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-10-21T21:04:18.688 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-10-21T21:04:18.732 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-10-21T21:04:18.733 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-10-21T21:04:18.781 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-10-21T21:04:18.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-10-21T21:04:18.967 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-10-21T21:04:18.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-10-21T21:04:19.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-10-21T21:04:19.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-10-21T21:04:19.152 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-21T21:04:19.201 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-21T21:04:19.201 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2023-10-21T21:04:19.201 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2023-10-21T21:04:19.201 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-21T21:04:19.202 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2023-10-21T21:04:19.202 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2023-10-21T21:04:19.202 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2023-10-21T21:04:19.202 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T21:04:19.202 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T21:04:19.203 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T21:04:19.203 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T21:04:19.203 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2023-10-21T21:04:19.203 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-10-21T21:04:19.204 DEBUG:teuthology.parallel:result is None 2023-10-21T21:04:19.422 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-10-21T21:04:19.423 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T21:04:19.449 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-10-21T21:04:19.449 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T21:04:19.478 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-10-21T21:04:19.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-21T21:04:19.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:04:19.555 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-10-21T21:04:19.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-21T21:04:19.667 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-10-21T21:04:19.712 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-10-21T21:04:19.713 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-21T21:04:19.760 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-21T21:04:19.760 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2023-10-21T21:04:19.760 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2023-10-21T21:04:19.760 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-21T21:04:19.761 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2023-10-21T21:04:19.761 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2023-10-21T21:04:19.761 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2023-10-21T21:04:19.761 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T21:04:19.761 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T21:04:19.762 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T21:04:19.762 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T21:04:19.762 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2023-10-21T21:04:19.762 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-21T21:04:19.782 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-10-21T21:04:19.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-21T21:04:19.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T21:04:19.863 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-21T21:04:20.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-21T21:04:20.115 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-10-21T21:04:20.162 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-10-21T21:04:20.163 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-21T21:04:20.210 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-21T21:04:20.211 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2023-10-21T21:04:20.211 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2023-10-21T21:04:20.211 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-21T21:04:20.211 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2023-10-21T21:04:20.212 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2023-10-21T21:04:20.212 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2023-10-21T21:04:20.212 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T21:04:20.212 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T21:04:20.213 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T21:04:20.213 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T21:04:20.213 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2023-10-21T21:04:20.213 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-21T21:04:20.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:04:20.318 INFO:teuthology.dispatcher.supervisor:Running job 7433040 2023-10-21T21:04:20.318 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-20_14:22:12-upgrade:octopus-x-quincy-distro-default-smithi/7433040 --name teuthology-2023-10-20_14:22:12-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} -- /home/teuthworker/archive/teuthology-2023-10-20_14:22:12-upgrade:octopus-x-quincy-distro-default-smithi/7433040/orig.config.yaml 2023-10-21T21:04:20.321 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-20_14:22:12-upgrade:octopus-x-quincy-distro-default-smithi/7433040 2023-10-21T21:04:20.322 INFO:teuthology.dispatcher.supervisor:Job PID: 1540053 2023-10-21T21:04:20.322 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T21:06:20.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:08:20.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:10:20.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:12:20.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:14:21.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:16:21.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:16:21.341 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T21:16:21.464 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T21:16:21.464 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T21:16:21.515 DEBUG:teuthology.nuke:shortname: smithi032 2023-10-21T21:16:21.515 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T21:16:21.537 DEBUG:teuthology.nuke:shortname: smithi179 2023-10-21T21:16:21.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T21:16:21.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-20_14:22:12-upgrade:octopus-x-quincy-distro-default-smithi/7433040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 20:58:00.169687', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVW1qRq8vka63tI2qRwZLMDCv2i9cqI2LVkIe8MxhZ8nT13pMsLQrMuMWUIvxRHQ7S/4wcMwUrUri5fTfcNysE='} 2023-10-21T21:16:21.558 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-20_14:22:12-upgrade:octopus-x-quincy-distro-default-smithi/7433040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 20:58:00.171569', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyYctXszJG3QT0Ww0rOYkNB14gJyz/cxJ1Z2m2lOES6+/TWkjVTpVz8zD+g4QW4Hy4yNU0WdKwO9TUGXH+FjvY='} 2023-10-21T21:16:21.589 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-21T21:16:21.590 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T21:16:21.611 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-21T21:16:21.612 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T21:16:21.626 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-21T21:16:21.627 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T21:16:21.635 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-21T21:16:21.648 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-21T21:16:21.648 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T21:16:21.667 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-21T21:16:21.736 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-21T21:16:21.769 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-21T21:16:21.882 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-10-21T21:16:21.916 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com