2023-10-29T03:28:43.741 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-29T03:28:43.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:28:43.916 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1170a17d30>, signals=[15]) 2023-10-29T03:28:43.917 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-10-29T03:28:43.918 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-10-29T03:28:43.918 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-29T03:28:43.949 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-10-29T03:28:43.950 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-10-29T03:28:43.950 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-10-29T03:28:43.951 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-10-29T03:28:43.974 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-10-29T03:28:43.974 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-10-29T03:28:43.975 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-29T03:28:43.976 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"} 2023-10-29T03:28:43.999 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-10-29T03:28:44.027 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-29T03:28:44.061 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-29T03:28:44.069 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-29T03:28:44.069 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 2} 2023-10-29T03:28:44.072 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-29T03:28:44.101 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-29T03:28:44.102 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 2} 2023-10-29T03:28:44.110 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of ubuntu 20.04 2023-10-29T03:28:44.110 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:28:44.113 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-29T03:28:44.113 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 2} 2023-10-29T03:28:44.155 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of ubuntu 20.04 2023-10-29T03:28:44.155 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:28:44.158 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 20.04 2023-10-29T03:28:44.158 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:28:44.168 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-10-29T03:28:44.203 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-10-29T03:28:44.207 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-10-29T03:28:44.210 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"} 2023-10-29T03:28:44.242 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-10-29T03:28:44.260 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1} 2023-10-29T03:28:44.296 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:28:44.308 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:28:44.312 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:28:44.391 INFO:teuthology.orchestra.console.smithi084:Power off 2023-10-29T03:28:44.392 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T03:28:44.406 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-29T03:28:44.406 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T03:28:44.417 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-29T03:28:44.418 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T03:28:44.425 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-10-29T03:28:44.426 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:44.434 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-29T03:28:44.435 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:44.442 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-29T03:28:44.445 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:44.452 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-29T03:28:44.458 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-29T03:28:44.467 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-29T03:28:48.458 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:48.466 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:48.472 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:48.568 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-29T03:28:48.574 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-29T03:28:48.581 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-29T03:28:52.570 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:52.577 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:52.583 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:52.679 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-10-29T03:28:52.684 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-29T03:28:52.690 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-29T03:28:52.780 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-10-29T03:28:52.792 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-29T03:28:52.882 INFO:teuthology.orchestra.console.smithi084:Power on 2023-10-29T03:28:52.882 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-29T03:28:52.893 INFO:teuthology.orchestra.console.smithi057:Power on 2023-10-29T03:28:52.894 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-29T03:28:52.903 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2023-10-29T03:28:52.904 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:52.913 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-10-29T03:28:52.914 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:52.924 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-10-29T03:28:52.934 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-29T03:28:56.686 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:56.795 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-29T03:28:56.896 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-29T03:28:56.926 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:56.934 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:56.997 INFO:teuthology.orchestra.console.smithi099:Power on 2023-10-29T03:28:56.998 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-29T03:28:57.019 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-10-29T03:28:57.020 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:28:57.034 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-10-29T03:28:57.040 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-29T03:28:57.043 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-29T03:29:01.038 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:29:01.044 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:29:01.050 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:29:01.147 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-29T03:29:01.152 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-29T03:29:01.248 INFO:teuthology.orchestra.console.smithi084:Power on completed 2023-10-29T03:29:01.263 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-29T03:29:01.350 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-10-29T03:29:01.350 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:29:01.364 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-10-29T03:29:01.465 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-10-29T03:29:01.466 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:29:05.154 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T03:29:05.263 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-29T03:29:05.364 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-10-29T03:29:05.465 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-10-29T03:29:05.465 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:29:16.423 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:29:16.528 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:29:20.534 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:29:31.498 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:29:31.595 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:29:35.614 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:29:46.574 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:29:46.658 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:29:50.682 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:30:01.643 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:30:01.717 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:30:05.754 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:30:16.717 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:30:16.774 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:30:20.826 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:30:31.808 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:30:31.827 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:30:35.894 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:30:46.886 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:30:46.888 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:30:50.958 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:31:01.963 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:31:01.964 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:31:06.034 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:31:17.038 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:31:17.040 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:31:21.114 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:31:32.118 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:31:32.120 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:31:36.190 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:31:47.194 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:31:47.196 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:31:51.262 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:32:02.262 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:32:02.264 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:32:06.322 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:32:17.332 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:32:17.333 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:32:21.382 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:32:32.399 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:32:32.400 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-10-29T03:32:32.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:32:36.439 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:32:47.462 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-29T03:32:47.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:32:50.938 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-29T03:32:51.496 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-29T03:32:51.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:32:56.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:00.026 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-29T03:33:06.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:06.042 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-29T03:33:09.086 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-29T03:33:09.886 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-29T03:33:12.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:15.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:15.102 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-29T03:33:15.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:18.174 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-29T03:33:18.970 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-29T03:33:21.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:24.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:24.190 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-29T03:33:24.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:27.262 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-29T03:33:28.030 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-29T03:33:30.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:33.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:33.278 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-29T03:33:34.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:37.086 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-29T03:33:39.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:42.366 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-29T03:33:43.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:33:48.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:34:15.360 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-29T03:34:15.361 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-29T03:34:33.269 WARNING:teuthology.provision.fog.smithi084:timed out 2023-10-29T03:34:36.092 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-10-29T03:34:36.093 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-10-29T03:34:36.099 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-10-29T03:34:36.100 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-10-29T03:34:36.148 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-10-29T03:34:36.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-29T03:34:36.229 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-10-29T03:34:36.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-10-29T03:34:36.302 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-10-29T03:34:36.314 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-29T03:34:36.324 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-29T03:34:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-10-29T03:34:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-29T03:34:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-10-29T03:34:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-10-29T03:34:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-29T03:34:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2023-10-29T03:34:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T03:34:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T03:34:36.332 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T03:34:36.332 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T03:34:36.332 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2023-10-29T03:34:36.332 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2023-10-29T03:34:36.333 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-10-29T03:34:36.334 DEBUG:teuthology.parallel:result is None 2023-10-29T03:34:39.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:34:39.484 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-29T03:34:39.485 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-29T03:34:40.009 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-10-29T03:34:40.010 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-10-29T03:34:40.016 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2023-10-29T03:34:40.017 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2023-10-29T03:34:40.023 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-10-29T03:34:40.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-10-29T03:34:40.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2023-10-29T03:34:40.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-10-29T03:34:40.139 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2023-10-29T03:34:40.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-10-29T03:34:40.206 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-10-29T03:34:40.211 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2023-10-29T03:34:40.211 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-29T03:34:40.211 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2023-10-29T03:34:40.211 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2023-10-29T03:34:40.212 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-29T03:34:40.212 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="20.04" 2023-10-29T03:34:40.212 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T03:34:40.212 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T03:34:40.212 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T03:34:40.213 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T03:34:40.213 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=focal 2023-10-29T03:34:40.213 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=focal 2023-10-29T03:34:40.213 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-10-29T03:34:40.214 DEBUG:teuthology.parallel:result is None 2023-10-29T03:34:48.385 WARNING:teuthology.provision.fog.smithi057:timed out 2023-10-29T03:34:54.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:34:54.585 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-29T03:34:54.586 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-29T03:34:55.140 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-10-29T03:34:55.140 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-10-29T03:34:55.147 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-10-29T03:34:55.147 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-10-29T03:34:55.154 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-10-29T03:34:55.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-29T03:34:55.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-10-29T03:34:55.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-10-29T03:34:55.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-10-29T03:34:55.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-29T03:34:55.387 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-29T03:34:55.435 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-10-29T03:34:55.435 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-29T03:34:55.435 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-10-29T03:34:55.435 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-10-29T03:34:55.436 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-29T03:34:55.436 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-10-29T03:34:55.436 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T03:34:55.436 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T03:34:55.436 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T03:34:55.437 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T03:34:55.437 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-10-29T03:34:55.437 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-10-29T03:34:55.437 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-10-29T03:34:55.438 DEBUG:teuthology.parallel:result is None 2023-10-29T03:34:55.727 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-10-29T03:34:55.728 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-29T03:34:55.757 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-10-29T03:34:55.758 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-29T03:34:55.782 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-10-29T03:34:55.782 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-29T03:34:55.800 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-10-29T03:34:55.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-29T03:34:55.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:34:55.853 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-29T03:34:55.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-29T03:34:55.977 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-29T03:34:55.983 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-29T03:34:55.984 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-29T03:34:56.031 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-10-29T03:34:56.031 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-29T03:34:56.031 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-10-29T03:34:56.032 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-10-29T03:34:56.032 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-29T03:34:56.032 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-10-29T03:34:56.032 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T03:34:56.032 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T03:34:56.033 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T03:34:56.033 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T03:34:56.033 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-10-29T03:34:56.033 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-10-29T03:34:56.033 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-29T03:34:56.057 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-10-29T03:34:56.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-29T03:34:56.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:34:56.104 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-10-29T03:34:56.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-29T03:34:56.312 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-10-29T03:34:56.362 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-10-29T03:34:56.362 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-10-29T03:34:56.369 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2023-10-29T03:34:56.369 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-29T03:34:56.369 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2023-10-29T03:34:56.370 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2023-10-29T03:34:56.370 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-29T03:34:56.370 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="20.04" 2023-10-29T03:34:56.370 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T03:34:56.370 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T03:34:56.371 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T03:34:56.371 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T03:34:56.371 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=focal 2023-10-29T03:34:56.371 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=focal 2023-10-29T03:34:56.371 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-10-29T03:34:56.391 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-10-29T03:34:56.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-29T03:34:56.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T03:34:56.440 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-10-29T03:34:56.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-29T03:34:56.652 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-10-29T03:34:56.658 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-10-29T03:34:56.659 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-29T03:34:56.665 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-10-29T03:34:56.665 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-29T03:34:56.666 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-10-29T03:34:56.666 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-10-29T03:34:56.666 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-29T03:34:56.666 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2023-10-29T03:34:56.667 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T03:34:56.667 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T03:34:56.667 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T03:34:56.667 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T03:34:56.667 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2023-10-29T03:34:56.668 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2023-10-29T03:34:56.668 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-29T03:34:56.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:34:56.787 INFO:teuthology.dispatcher.supervisor:Running job 7439869 2023-10-29T03:34:56.787 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-29_01:35:03-upgrade:quincy-p2p-quincy-distro-default-smithi/7439869 --name teuthology-2023-10-29_01:35:03-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/teuthology-2023-10-29_01:35:03-upgrade:quincy-p2p-quincy-distro-default-smithi/7439869/orig.config.yaml 2023-10-29T03:34:56.790 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-29_01:35:03-upgrade:quincy-p2p-quincy-distro-default-smithi/7439869 2023-10-29T03:34:56.790 INFO:teuthology.dispatcher.supervisor:Job PID: 3391316 2023-10-29T03:34:56.791 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-29T03:36:56.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:38:57.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:40:57.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:42:57.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:44:57.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:46:57.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:48:57.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:50:58.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:52:58.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:54:58.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:56:58.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T03:58:58.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:00:58.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:02:59.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:04:59.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:06:59.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:08:59.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:10:59.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:12:59.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:14:59.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:17:00.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:19:00.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:21:00.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:23:00.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:25:00.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:27:00.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:29:01.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:31:01.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:33:01.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:35:01.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:37:01.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:39:01.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:41:01.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:43:02.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:45:02.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:47:02.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:49:02.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:51:02.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:53:03.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:55:03.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:57:03.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T04:59:03.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:01:03.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:03:03.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:05:04.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:07:04.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:09:04.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:11:04.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:13:04.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:15:04.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:17:05.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:19:05.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:21:05.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:23:05.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:25:05.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:27:06.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:29:06.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:31:06.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:33:06.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:35:06.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T05:35:06.916 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-29T05:35:07.113 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-29T05:35:07.113 INFO:teuthology.nuke:Checking targets against current locks 2023-10-29T05:35:07.164 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-29T05:35:07.165 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-29T05:35:07.184 DEBUG:teuthology.nuke:shortname: smithi084 2023-10-29T05:35:07.184 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-29T05:35:07.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-29_01:35:03-upgrade:quincy-p2p-quincy-distro-default-smithi/7439869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-29 03:28:42.857145', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-29T05:35:07.208 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-29_01:35:03-upgrade:quincy-p2p-quincy-distro-default-smithi/7439869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-29 03:28:42.856155', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-29T05:35:07.211 DEBUG:teuthology.nuke:shortname: smithi099 2023-10-29T05:35:07.212 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-29T05:35:07.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-29_01:35:03-upgrade:quincy-p2p-quincy-distro-default-smithi/7439869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-29 03:28:42.854982', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-29T05:35:07.243 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-29T05:35:07.243 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T05:35:07.257 INFO:teuthology.orchestra.console.smithi084:Power off 2023-10-29T05:35:07.258 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T05:35:07.266 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-29T05:35:07.267 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T05:35:07.279 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-10-29T05:35:07.279 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T05:35:07.290 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-29T05:35:07.302 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-29T05:35:07.303 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T05:35:07.310 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-10-29T05:35:07.322 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-29T05:35:07.322 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T05:35:07.343 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-29T05:35:07.391 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-29T05:35:07.411 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-10-29T05:35:07.444 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-29T05:35:07.569 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-10-29T05:35:07.591 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2023-10-29T05:35:07.600 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com