2024-02-09T03:24:05.793 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-09T03:24:05.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T03:24:05.949 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9dc11ac10>, signals=[15]) 2024-02-09T03:24:05.949 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2024-02-09T03:24:05.950 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T03:24:05.950 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-02-09T03:24:05.967 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2024-02-09T03:24:05.967 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T03:24:05.967 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-02-09T03:24:06.074 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_ubuntu_18.04 (ID 1) 2024-02-09T03:24:06.095 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_ubuntu_18.04 (ID 1) 2024-02-09T03:24:06.120 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of ubuntu 18.04 2024-02-09T03:24:06.135 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of ubuntu 18.04 2024-02-09T03:24:06.371 INFO:teuthology.orchestra.console.smithi063:Power off 2024-02-09T03:24:06.371 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T03:24:06.384 INFO:teuthology.orchestra.console.smithi120:Power off 2024-02-09T03:24:06.384 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T03:24:06.392 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2024-02-09T03:24:06.392 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T03:24:06.407 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-02-09T03:24:06.407 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T03:24:06.416 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-02-09T03:24:06.431 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-02-09T03:24:06.517 INFO:teuthology.orchestra.console.smithi063:Power off completed 2024-02-09T03:24:06.532 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-02-09T03:24:06.618 INFO:teuthology.orchestra.console.smithi063:Power on 2024-02-09T03:24:06.618 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T03:24:06.633 INFO:teuthology.orchestra.console.smithi120:Power on 2024-02-09T03:24:06.633 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T03:24:06.643 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On 2024-02-09T03:24:06.643 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T03:24:06.659 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2024-02-09T03:24:06.660 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T03:24:06.669 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-02-09T03:24:06.682 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-02-09T03:24:10.672 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T03:24:10.683 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T03:24:10.781 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-02-09T03:24:10.793 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-02-09T03:24:10.883 INFO:teuthology.orchestra.console.smithi063:Power on completed 2024-02-09T03:24:10.983 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2024-02-09T03:24:14.796 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T03:24:14.905 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-02-09T03:24:15.005 INFO:teuthology.orchestra.console.smithi120:Power on completed 2024-02-09T03:24:15.106 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2024-02-09T03:27:27.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:27:30.368 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:27:31.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:27:34.428 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:27:36.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:27:39.456 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:27:40.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:27:43.484 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:27:45.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:27:48.540 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:27:49.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:27:52.540 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:27:54.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:27:57.596 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:27:58.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:01.596 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:28:03.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:06.652 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:28:07.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:10.688 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:28:12.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:15.708 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:28:16.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:19.772 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:28:21.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:24.764 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:28:25.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:35.900 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:28:41.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:44.956 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:28:50.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:28:54.051 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:29:00.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:03.136 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:29:09.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:12.220 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:29:18.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:21.312 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:29:27.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:30.396 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:29:30.771 WARNING:teuthology.provision.fog.smithi063:timed out 2024-02-09T03:29:36.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:36.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:39.484 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:29:45.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:48.576 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:29:54.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:29:55.260 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:29:57.664 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:30:01.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:03.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:04.316 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:30:06.748 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:30:10.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:12.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:13.372 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:30:15.808 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:30:19.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:21.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:22.428 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:30:24.892 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:30:28.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:30.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:31.484 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:30:33.948 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:30:37.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:39.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:40.544 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:30:43.004 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:30:46.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:49.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:49.628 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:30:52.060 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:30:55.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:58.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:30:58.688 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:31:01.120 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:31:04.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:07.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:07.776 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:31:10.204 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:31:13.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:16.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:16.864 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:31:19.260 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:31:22.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:25.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:25.952 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:31:28.316 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:31:31.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:34.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:35.036 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:31:37.372 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:31:41.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:43.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:44.092 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:31:46.428 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:31:50.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:52.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:31:53.152 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:31:55.484 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:31:59.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:01.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:02.236 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:32:04.540 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:32:08.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:10.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:11.296 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:32:13.596 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:32:17.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:19.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:20.380 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:32:22.652 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:32:26.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:28.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:29.440 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:32:31.740 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:32:35.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:37.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:38.528 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:32:40.796 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:32:44.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:46.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:47.616 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:32:49.852 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:32:53.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:55.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:32:56.704 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:32:58.912 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:33:02.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:04.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:05.792 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:33:07.996 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:33:11.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:14.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:14.876 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:33:17.052 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-02-09T03:33:20.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:23.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:23.527 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-09T03:33:23.527 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-09T03:33:23.936 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:33:29.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:32.988 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-09T03:33:38.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:33:39.203 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-09T03:33:39.203 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-09T03:33:47.399 INFO:teuthology.provision.fog.smithi120:Node is ready 2024-02-09T03:33:47.399 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2024-02-09T03:33:47.406 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2024-02-09T03:33:47.406 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2024-02-09T03:33:47.457 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2024-02-09T03:33:47.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-02-09T03:33:47.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2024-02-09T03:33:47.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2024-02-09T03:33:47.650 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2024-02-09T03:33:47.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-02-09T03:33:47.766 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-02-09T03:33:47.816 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-02-09T03:33:47.816 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T03:33:47.816 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-02-09T03:33:47.816 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-02-09T03:33:47.816 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T03:33:47.816 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="18.04" 2024-02-09T03:33:47.816 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T03:33:47.817 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T03:33:47.817 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T03:33:47.817 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T03:33:47.817 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=bionic 2024-02-09T03:33:47.817 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=bionic 2024-02-09T03:33:47.818 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2024-02-09T03:33:47.819 DEBUG:teuthology.parallel:result is None 2024-02-09T03:33:59.893 INFO:teuthology.provision.fog.smithi063:Node is ready 2024-02-09T03:33:59.893 DEBUG:teuthology.orchestra.run.smithi063:> hostname 2024-02-09T03:33:59.899 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com 2024-02-09T03:33:59.900 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts 2024-02-09T03:33:59.948 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2024-02-09T03:33:59.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2024-02-09T03:34:00.047 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts 2024-02-09T03:34:00.063 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts 2024-02-09T03:34:00.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname 2024-02-09T03:34:00.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2024-02-09T03:34:00.224 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-02-09T03:34:00.271 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2024-02-09T03:34:00.271 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T03:34:00.271 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2024-02-09T03:34:00.271 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2024-02-09T03:34:00.271 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T03:34:00.271 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="18.04" 2024-02-09T03:34:00.272 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T03:34:00.272 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T03:34:00.272 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T03:34:00.272 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T03:34:00.272 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=bionic 2024-02-09T03:34:00.272 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=bionic 2024-02-09T03:34:00.272 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2024-02-09T03:34:00.272 DEBUG:teuthology.parallel:result is None 2024-02-09T03:34:00.447 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2024-02-09T03:34:00.447 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-09T03:34:00.472 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2024-02-09T03:34:00.474 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2024-02-09T03:34:00.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-09T03:34:00.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:34:00.556 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-02-09T03:34:00.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-09T03:34:00.673 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-02-09T03:34:00.719 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-02-09T03:34:00.719 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-02-09T03:34:00.767 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2024-02-09T03:34:00.767 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T03:34:00.767 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="18.04" 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=bionic 2024-02-09T03:34:00.768 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=bionic 2024-02-09T03:34:00.768 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-02-09T03:34:00.798 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2024-02-09T03:34:00.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-02-09T03:34:00.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T03:34:00.876 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-02-09T03:34:01.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-02-09T03:34:01.045 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-02-09T03:34:01.092 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-02-09T03:34:01.092 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="18.04" 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T03:34:01.140 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T03:34:01.141 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T03:34:01.141 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T03:34:01.141 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=bionic 2024-02-09T03:34:01.141 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=bionic 2024-02-09T03:34:01.141 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-02-09T03:34:01.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T03:34:01.250 INFO:teuthology.dispatcher.supervisor:Running job 7552705 2024-02-09T03:34:01.250 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-08_23:15:40-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7552705 --name yuriw-2024-02-08_23:15:40-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --description rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} -- /home/teuthworker/archive/yuriw-2024-02-08_23:15:40-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7552705/orig.config.yaml 2024-02-09T03:34:01.253 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-08_23:15:40-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7552705 2024-02-09T03:34:01.253 INFO:teuthology.dispatcher.supervisor:Job PID: 1081948 2024-02-09T03:34:01.254 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-09T03:36:01.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T03:38:01.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T03:40:01.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T03:42:01.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T03:44:02.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T03:44:02.094 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1