2023-09-21T15:58:41.375 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T15:58:41.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T15:58:41.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f73a2ba8670>, signals=[15]) 2023-09-21T15:58:41.585 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2023-09-21T15:58:41.585 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T15:58:41.586 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-09-21T15:58:41.602 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-09-21T15:58:41.603 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T15:58:41.604 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-09-21T15:58:41.606 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /host {"name": "smithi044"} 2023-09-21T15:58:41.627 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-09-21T15:58:41.627 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T15:58:41.627 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-09-21T15:58:41.629 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-09-21T15:58:41.710 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2023-09-21T15:58:41.711 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T15:58:41.711 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-09-21T15:58:41.713 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-09-21T15:58:41.727 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /host {"name": "smithi204"} 2023-09-21T15:58:41.783 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-21T15:58:41.795 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-21T15:58:41.799 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-21T15:58:41.827 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-21T15:58:41.859 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-21T15:58:41.860 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 6} 2023-09-21T15:58:41.863 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-21T15:58:41.863 DEBUG:teuthology.provision.fog.smithi204:FOG request: PUT /host/308 {"imageID": 6} 2023-09-21T15:58:41.864 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-21T15:58:41.865 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 6} 2023-09-21T15:58:41.916 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-21T15:58:41.917 DEBUG:teuthology.provision.fog.smithi044:FOG request: PUT /host/149 {"imageID": 6} 2023-09-21T15:58:42.001 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of ubuntu 22.04 2023-09-21T15:58:42.002 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T15:58:42.009 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of ubuntu 22.04 2023-09-21T15:58:42.009 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T15:58:42.012 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of ubuntu 22.04 2023-09-21T15:58:42.012 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T15:58:42.103 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of ubuntu 22.04 2023-09-21T15:58:42.104 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T15:58:42.188 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T15:58:42.202 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T15:58:42.215 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T15:58:42.281 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T15:58:42.379 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-09-21T15:58:42.385 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-09-21T15:58:42.388 DEBUG:teuthology.provision.fog.smithi204:FOG request: POST /host/308/task {"taskTypeID": 1} 2023-09-21T15:58:42.428 DEBUG:teuthology.provision.fog.smithi044:FOG request: POST /host/149/task {"taskTypeID": 1} 2023-09-21T15:58:42.652 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T15:58:42.657 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T15:58:42.694 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T15:58:42.720 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T15:58:42.893 INFO:teuthology.orchestra.console.smithi204:Power off 2023-09-21T15:58:42.894 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T15:58:42.991 INFO:teuthology.orchestra.console.smithi145:Power off 2023-09-21T15:58:42.991 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T15:58:43.039 INFO:teuthology.orchestra.console.smithi090:Power off 2023-09-21T15:58:43.039 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T15:58:43.051 INFO:teuthology.orchestra.console.smithi044:Power off 2023-09-21T15:58:43.051 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T15:58:43.205 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2023-09-21T15:58:43.206 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:43.214 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-09-21T15:58:43.214 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:43.221 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-09-21T15:58:43.222 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:43.228 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-09-21T15:58:43.229 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:43.237 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-09-21T15:58:43.238 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-21T15:58:43.244 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-21T15:58:43.252 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-09-21T15:58:43.346 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-09-21T15:58:43.447 INFO:teuthology.orchestra.console.smithi145:Power on 2023-09-21T15:58:43.447 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T15:58:43.468 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2023-09-21T15:58:43.469 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:43.490 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-21T15:58:47.242 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:47.250 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:47.258 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:47.352 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-09-21T15:58:47.360 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-21T15:58:47.366 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-09-21T15:58:47.491 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:47.599 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-21T15:58:51.357 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:51.366 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:51.373 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:51.469 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-09-21T15:58:51.475 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-21T15:58:51.484 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-09-21T15:58:51.570 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-09-21T15:58:51.586 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-09-21T15:58:51.600 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:51.672 INFO:teuthology.orchestra.console.smithi090:Power on 2023-09-21T15:58:51.672 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T15:58:51.687 INFO:teuthology.orchestra.console.smithi204:Power on 2023-09-21T15:58:51.687 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T15:58:51.697 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2023-09-21T15:58:51.698 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:51.708 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2023-09-21T15:58:51.708 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:51.715 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-21T15:58:51.719 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-09-21T15:58:51.729 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-09-21T15:58:51.816 INFO:teuthology.orchestra.console.smithi145:Power on completed 2023-09-21T15:58:51.917 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-09-21T15:58:51.918 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T15:58:55.480 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:55.590 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-21T15:58:55.692 INFO:teuthology.orchestra.console.smithi044:Power off completed 2023-09-21T15:58:55.721 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:55.730 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:55.793 INFO:teuthology.orchestra.console.smithi044:Power on 2023-09-21T15:58:55.794 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T15:58:55.817 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2023-09-21T15:58:55.817 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:55.832 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-09-21T15:58:55.839 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-09-21T15:58:55.840 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-21T15:58:55.940 INFO:teuthology.orchestra.console.smithi204:Power on completed 2023-09-21T15:58:56.041 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2023-09-21T15:58:56.041 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T15:58:59.837 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:59.846 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:58:59.955 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-21T15:58:59.972 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-09-21T15:59:00.073 INFO:teuthology.orchestra.console.smithi090:Power on completed 2023-09-21T15:59:00.174 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-09-21T15:59:00.174 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T15:59:03.960 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T15:59:04.069 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-21T15:59:04.170 INFO:teuthology.orchestra.console.smithi044:Power on completed 2023-09-21T15:59:04.271 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2023-09-21T15:59:04.271 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T15:59:07.027 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T15:59:11.151 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T15:59:15.314 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T15:59:19.382 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T15:59:22.139 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T15:59:26.256 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T15:59:30.462 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T15:59:34.498 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T15:59:37.257 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T15:59:41.378 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T15:59:45.612 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T15:59:49.606 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T15:59:52.368 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T15:59:56.487 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:00:00.762 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:00:04.727 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:00:07.474 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:00:11.621 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:00:15.934 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:00:19.834 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:00:22.606 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:00:26.734 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:00:31.086 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:00:34.969 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:00:37.738 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:00:41.870 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:00:46.275 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:00:50.100 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:00:52.902 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:00:57.031 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:01:01.506 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:01:05.252 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:01:08.091 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:01:12.273 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:01:16.686 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:01:20.393 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:01:23.241 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:01:27.442 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:01:31.890 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:01:35.560 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:01:38.400 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:01:42.601 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:01:47.118 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:01:50.674 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:01:53.522 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:01:57.878 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:02:02.274 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:02:05.798 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-21T16:02:05.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:02:06.053 ERROR:teuthology.orchestra.connection:Error authenticating with smithi044.front.sepia.ceph.com: Authentication failed. 2023-09-21T16:02:06.055 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T16:02:06.056 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T16:02:06.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-21T16:02:08.639 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-21T16:02:08.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:02:12.994 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:02:17.429 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:02:27.098 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-21T16:02:28.146 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-09-21T16:02:28.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:02:32.541 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:02:33.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:02:36.154 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-21T16:02:42.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:02:45.210 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-21T16:02:46.810 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:02:47.664 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:02:51.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:02:52.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:02:54.266 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-21T16:02:55.866 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:03:00.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:01.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:02.750 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:03:03.322 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-21T16:03:04.922 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:03:09.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:10.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:13.978 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:03:17.836 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:03:19.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:32.899 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:03:38.522 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:03:44.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:47.578 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:03:47.959 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T16:03:48.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:53.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:03:56.634 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:04:02.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:02.638 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:04:06.426 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T16:04:08.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:08.642 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:04:09.328 WARNING:teuthology.provision.fog.smithi145:timed out 2023-09-21T16:04:12.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:14.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:14.646 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:04:15.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:15.482 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T16:04:15.558 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T16:04:15.558 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T16:04:16.027 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-09-21T16:04:16.027 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-09-21T16:04:16.076 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-09-21T16:04:16.077 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-09-21T16:04:16.124 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-09-21T16:04:16.125 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-09-21T16:04:16.250 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-09-21T16:04:16.265 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-09-21T16:04:16.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-09-21T16:04:16.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-09-21T16:04:16.440 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-09-21T16:04:16.488 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:04:16.489 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2023-09-21T16:04:16.489 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04" 2023-09-21T16:04:16.490 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:04:16.490 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy 2023-09-21T16:04:16.490 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2023-09-21T16:04:16.490 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2023-09-21T16:04:16.491 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:04:16.491 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:04:16.491 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:04:16.491 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:04:16.492 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:04:16.493 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-09-21T16:04:16.495 DEBUG:teuthology.parallel:result is None 2023-09-21T16:04:20.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:20.650 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-09-21T16:04:21.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:24.538 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T16:04:26.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:26.863 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T16:04:26.863 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T16:04:27.285 INFO:teuthology.provision.fog.smithi204:Node is ready 2023-09-21T16:04:27.285 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2023-09-21T16:04:27.331 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2023-09-21T16:04:27.331 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2023-09-21T16:04:27.379 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2023-09-21T16:04:27.380 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-09-21T16:04:27.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2023-09-21T16:04:27.524 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2023-09-21T16:04:27.584 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2023-09-21T16:04:27.638 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-09-21T16:04:27.693 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-09-21T16:04:27.738 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:04:27.739 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2023-09-21T16:04:27.739 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04" 2023-09-21T16:04:27.739 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:04:27.740 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy 2023-09-21T16:04:27.740 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2023-09-21T16:04:27.740 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2023-09-21T16:04:27.740 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:04:27.741 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:04:27.741 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:04:27.741 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:04:27.742 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:04:27.742 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2023-09-21T16:04:27.743 DEBUG:teuthology.parallel:result is None 2023-09-21T16:04:30.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:33.594 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T16:04:39.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:42.650 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T16:04:48.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:04:51.706 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T16:04:57.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:05:45.502 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-21T16:05:45.526 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi044 2023-09-21T16:05:54.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-21T16:05:54.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:05:54.707 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-09-21T16:05:55.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-21T16:05:55.205 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T16:05:55.205 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T16:05:55.250 INFO:teuthology.provision.fog.smithi044:Node is ready 2023-09-21T16:05:55.250 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2023-09-21T16:05:55.298 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2023-09-21T16:05:55.299 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2023-09-21T16:05:55.347 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2023-09-21T16:05:55.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2023-09-21T16:05:55.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2023-09-21T16:05:55.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2023-09-21T16:05:55.588 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2023-09-21T16:05:55.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2023-09-21T16:05:55.706 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-09-21T16:05:55.758 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:05:55.759 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2023-09-21T16:05:55.759 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04" 2023-09-21T16:05:55.759 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:05:55.759 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy 2023-09-21T16:05:55.759 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2023-09-21T16:05:55.760 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2023-09-21T16:05:55.760 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:05:55.760 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:05:55.760 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:05:55.760 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:05:55.760 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:05:55.761 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2023-09-21T16:05:55.761 DEBUG:teuthology.parallel:result is None 2023-09-21T16:05:57.711 WARNING:teuthology.provision.fog.smithi090:timed out 2023-09-21T16:06:03.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:06:03.715 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T16:06:09.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:06:09.964 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T16:06:09.964 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T16:06:10.487 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-09-21T16:06:10.487 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-09-21T16:06:10.533 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-09-21T16:06:10.533 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-09-21T16:06:10.585 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-09-21T16:06:10.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-09-21T16:06:10.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-09-21T16:06:10.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-09-21T16:06:10.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-09-21T16:06:10.842 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-09-21T16:06:10.896 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-09-21T16:06:10.945 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:06:10.945 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2023-09-21T16:06:10.946 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="22.04" 2023-09-21T16:06:10.946 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:06:10.946 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=jammy 2023-09-21T16:06:10.946 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2023-09-21T16:06:10.947 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2023-09-21T16:06:10.947 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:06:10.947 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:06:10.947 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:06:10.947 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:06:10.947 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:06:10.948 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-09-21T16:06:10.949 DEBUG:teuthology.parallel:result is None 2023-09-21T16:06:11.263 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2023-09-21T16:06:11.264 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T16:06:11.288 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-09-21T16:06:11.288 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T16:06:11.313 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-09-21T16:06:11.313 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T16:06:11.329 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2023-09-21T16:06:11.330 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T16:06:11.347 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2023-09-21T16:06:11.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-21T16:06:11.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:06:11.423 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-09-21T16:06:11.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-21T16:06:11.527 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2023-09-21T16:06:11.575 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2023-09-21T16:06:11.575 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-09-21T16:06:11.623 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:06:11.623 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2023-09-21T16:06:11.623 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04" 2023-09-21T16:06:11.623 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:06:11.624 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy 2023-09-21T16:06:11.624 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2023-09-21T16:06:11.624 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2023-09-21T16:06:11.624 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:06:11.624 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:06:11.625 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:06:11.625 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:06:11.625 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:06:11.625 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-09-21T16:06:11.647 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-09-21T16:06:11.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-09-21T16:06:11.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:06:11.724 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-09-21T16:06:11.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-09-21T16:06:11.818 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-09-21T16:06:11.870 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-09-21T16:06:11.870 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-09-21T16:06:11.917 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:06:11.917 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2023-09-21T16:06:11.917 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="22.04" 2023-09-21T16:06:11.917 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:06:11.917 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=jammy 2023-09-21T16:06:11.918 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2023-09-21T16:06:11.918 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2023-09-21T16:06:11.918 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:06:11.918 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:06:11.918 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:06:11.919 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:06:11.919 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:06:11.919 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-09-21T16:06:11.938 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-09-21T16:06:11.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-09-21T16:06:11.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:06:12.015 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-09-21T16:06:12.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-09-21T16:06:12.242 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-09-21T16:06:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-09-21T16:06:12.288 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-09-21T16:06:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:06:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2023-09-21T16:06:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04" 2023-09-21T16:06:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:06:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy 2023-09-21T16:06:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2023-09-21T16:06:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2023-09-21T16:06:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:06:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:06:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:06:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:06:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:06:12.338 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-09-21T16:06:12.363 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2023-09-21T16:06:12.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-09-21T16:06:12.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T16:06:12.441 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-09-21T16:06:12.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-09-21T16:06:12.558 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-09-21T16:06:12.603 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-09-21T16:06:12.603 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-09-21T16:06:12.651 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T16:06:12.651 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2023-09-21T16:06:12.652 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04" 2023-09-21T16:06:12.652 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T16:06:12.652 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy 2023-09-21T16:06:12.652 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2023-09-21T16:06:12.652 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2023-09-21T16:06:12.653 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T16:06:12.653 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T16:06:12.653 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T16:06:12.653 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T16:06:12.653 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy 2023-09-21T16:06:12.654 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-09-21T16:06:12.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T16:06:12.762 INFO:teuthology.dispatcher.supervisor:Running job 7400205 2023-09-21T16:06:12.763 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-09-21_15:58:02-fs:multiclient-wip-rishabh-2023sep12-b2-testing-default-smithi/7400205 --name rishabh-2023-09-21_15:58:02-fs:multiclient-wip-rishabh-2023sep12-b2-testing-default-smithi --description fs:multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} -- /home/teuthworker/archive/rishabh-2023-09-21_15:58:02-fs:multiclient-wip-rishabh-2023sep12-b2-testing-default-smithi/7400205/orig.config.yaml 2023-09-21T16:06:12.766 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-09-21_15:58:02-fs:multiclient-wip-rishabh-2023sep12-b2-testing-default-smithi/7400205 2023-09-21T16:06:12.767 INFO:teuthology.dispatcher.supervisor:Job PID: 1508623 2023-09-21T16:06:12.767 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-21T16:08:38.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T16:12:58.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T16:15:07.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T16:17:23.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T16:19:27.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/