2023-12-06T09:05:19.549 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-06T09:05:19.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T09:05:19.715 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4379daa550>, signals=[15]) 2023-12-06T09:05:19.716 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-12-06T09:05:19.716 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-12-06T09:05:19.717 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-12-06T09:05:19.742 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-12-06T09:05:19.742 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-12-06T09:05:19.742 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-12-06T09:05:19.856 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10) 2023-12-06T09:05:19.882 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_9.stream (ID 10) 2023-12-06T09:05:19.915 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream 2023-12-06T09:05:19.929 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 9.stream 2023-12-06T09:05:20.202 INFO:teuthology.orchestra.console.smithi134:Power off 2023-12-06T09:05:20.203 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T09:05:20.223 INFO:teuthology.orchestra.console.smithi052:Power off 2023-12-06T09:05:20.223 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T09:05:20.233 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-12-06T09:05:20.233 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:20.246 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-12-06T09:05:20.246 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:20.275 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-12-06T09:05:20.287 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-06T09:05:24.278 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:24.288 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:24.390 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-12-06T09:05:24.399 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-06T09:05:28.394 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:28.401 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:28.503 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-12-06T09:05:28.510 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-06T09:05:28.604 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-12-06T09:05:28.705 INFO:teuthology.orchestra.console.smithi052:Power on 2023-12-06T09:05:28.705 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-06T09:05:28.728 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On 2023-12-06T09:05:28.729 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:28.756 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-12-06T09:05:32.514 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:32.623 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-06T09:05:32.724 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-12-06T09:05:32.757 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:32.825 INFO:teuthology.orchestra.console.smithi134:Power on 2023-12-06T09:05:32.826 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-06T09:05:32.849 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-12-06T09:05:32.849 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:32.867 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-12-06T09:05:32.873 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-06T09:05:32.968 INFO:teuthology.orchestra.console.smithi052:Power on completed 2023-12-06T09:05:33.069 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-12-06T09:05:36.874 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:36.986 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-06T09:05:40.990 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T09:05:41.100 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-06T09:05:41.201 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-12-06T09:05:41.302 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-12-06T09:08:04.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:07.106 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:08:12.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:13.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:15.298 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:08:16.166 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:08:21.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:22.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:24.358 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:08:25.250 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:08:30.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:31.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:33.442 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:08:34.306 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:08:39.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:40.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:42.502 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:08:43.362 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:08:48.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:49.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:08:51.586 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:08:57.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:09:00.642 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:09:06.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:09:49.407 WARNING:teuthology.provision.fog.smithi052:timed out 2023-12-06T09:09:55.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:06.658 WARNING:teuthology.provision.fog.smithi134:timed out 2023-12-06T09:10:12.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:13.862 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:10:15.715 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:10:19.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:21.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:22.946 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:10:24.774 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:10:28.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:30.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:32.006 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:10:33.858 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:10:38.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:39.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:41.090 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:10:42.914 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:10:47.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:48.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:50.150 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:10:51.974 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:10:56.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:57.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:10:59.238 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:11:01.058 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:11:05.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:11:07.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:11:17.350 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:11:23.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:11:26.438 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:11:32.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:11:32.577 ERROR:teuthology.orchestra.connection:Error authenticating with smithi134.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:11:36.706 ERROR:teuthology.orchestra.connection:Error authenticating with smithi134.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:11:36.930 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:11:41.059 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:11:43.796 ERROR:teuthology.orchestra.connection:Error authenticating with smithi134.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:11:48.149 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:11:53.884 ERROR:teuthology.orchestra.connection:Error authenticating with smithi134.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:11:58.242 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:12:06.975 ERROR:teuthology.orchestra.connection:Error authenticating with smithi134.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:12:11.332 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:12:23.104 ERROR:teuthology.orchestra.connection:Error authenticating with smithi134.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:12:27.462 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T09:12:52.322 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:12:56.678 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:12:58.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:01.378 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:13:02.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:05.733 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:13:07.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:10.434 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:13:11.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:14.790 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:13:16.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:16.578 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:13:20.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:22.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:23.878 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-06T09:13:25.638 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:13:29.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:31.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:41.986 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:13:47.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:13:51.042 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:13:57.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:14:00.102 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:14:06.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:14:06.246 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-06T09:14:12.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:14:12.332 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-06T09:14:12.333 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-06T09:14:29.881 WARNING:teuthology.provision.fog.smithi052:timed out 2023-12-06T09:14:32.401 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-12-06T09:14:32.401 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-12-06T09:14:32.419 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 2023-12-06T09:14:32.420 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134 /etc/hosts 2023-12-06T09:14:32.476 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134 smithi134 2023-12-06T09:14:32.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-12-06T09:14:32.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134/smithi134/g' /etc/hosts 2023-12-06T09:14:32.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-12-06T09:14:32.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134/smithi134/g' /etc/hostname 2023-12-06T09:14:32.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-12-06T09:14:32.820 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-12-06T09:14:32.875 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-12-06T09:14:32.875 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2023-12-06T09:14:32.875 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-12-06T09:14:32.875 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-12-06T09:14:32.875 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2023-12-06T09:14:32.875 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2023-12-06T09:14:32.875 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-06T09:14:32.876 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-12-06T09:14:32.876 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2023-12-06T09:14:32.876 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-06T09:14:32.876 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-12-06T09:14:32.876 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T09:14:32.876 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-06T09:14:32.876 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T09:14:32.877 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-12-06T09:14:32.878 DEBUG:teuthology.parallel:result is None 2023-12-06T09:14:35.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T09:14:36.239 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-06T09:14:36.239 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-06T09:14:36.575 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-12-06T09:14:36.575 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2023-12-06T09:14:36.594 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-12-06T09:14:36.595 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2023-12-06T09:14:36.653 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-12-06T09:14:36.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-12-06T09:14:36.782 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2023-12-06T09:14:36.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2023-12-06T09:14:36.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2023-12-06T09:14:36.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-12-06T09:14:37.022 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-12-06T09:14:37.080 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux" 2023-12-06T09:14:37.080 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)" 2023-12-06T09:14:37.080 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel" 2023-12-06T09:14:37.080 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora" 2023-12-06T09:14:37.080 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-06T09:14:37.081 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-06T09:14:37.083 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi052's OS to be centos 9 but found rhel 8.6 2023-12-06T09:14:37.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T09:14:37.235 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ab5e7b0c34e04ccd981a9459a3b7047f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi052's OS to be centos 9 but found rhel 8.6 2023-12-06T09:14:37.237 INFO:teuthology.nuke:Checking targets against current locks 2023-12-06T09:14:37.274 INFO:teuthology.nuke:Not nuking smithi052.front.sepia.ceph.com because description doesn't match: yuvalif-2023-12-06_09:03:08-fs:verify-wip-yuval-remove-lua-devel-distro-default-smithi != /home/teuthworker/archive/sseshasa-2023-12-06_06:16:39-rados-wip-sseshasa-testing-2023-12-04-1848-distro-default-smithi/7479650 2023-12-06T09:14:37.300 INFO:teuthology.nuke:Not nuking smithi134.front.sepia.ceph.com because description doesn't match: yuvalif-2023-12-06_09:03:08-fs:verify-wip-yuval-remove-lua-devel-distro-default-smithi != /home/teuthworker/archive/sseshasa-2023-12-06_06:16:39-rados-wip-sseshasa-testing-2023-12-04-1848-distro-default-smithi/7479645 2023-12-06T09:14:37.302 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHeSCSx852cb7nxbaLEbOhDMV+DFlUbt3rmCj7LVtNb7OB+czo/DO4TwAS5xasjjHCrxwTakh1n5nZWQePC/B4= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8jPjcD7pe2Z87g/0TRyBOiU9lESnAh/ePi+hxvsLw+MXLNOyb4Igcgocv/hfSLyHTHF9h65XBHD2VHX0IPR2U= 2023-12-06T09:14:37.564 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi052's OS to be centos 9 but found rhel 8.6