2024-01-05T16:42:24.043 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-05T16:42:24.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T16:42:24.217 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4767a11580>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4768959940>, signals=[15])
2024-01-05T16:42:24.218 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-01-05T16:42:24.218 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T16:42:24.219 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-05T16:42:24.241 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2024-01-05T16:42:24.241 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T16:42:24.241 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2024-01-05T16:42:24.263 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2024-01-05T16:42:24.263 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T16:42:24.264 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-05T16:42:24.357 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_8.stream (ID 3)
2024-01-05T16:42:24.372 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_8.stream (ID 3)
2024-01-05T16:42:24.401 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3)
2024-01-05T16:42:24.405 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 8.stream
2024-01-05T16:42:24.409 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.stream
2024-01-05T16:42:24.444 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream
2024-01-05T16:42:24.502 DEBUG:teuthology.provision.fog.smithi159:Canceling deploy task with ID 699968
2024-01-05T16:42:24.660 INFO:teuthology.orchestra.console.smithi113:Power off
2024-01-05T16:42:24.660 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:42:24.673 INFO:teuthology.orchestra.console.smithi124:Power off
2024-01-05T16:42:24.673 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:42:24.680 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-01-05T16:42:24.681 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:24.692 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2024-01-05T16:42:24.693 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:24.703 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-05T16:42:24.712 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-05T16:42:24.804 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-01-05T16:42:24.813 INFO:teuthology.orchestra.console.smithi124:Power off completed
2024-01-05T16:42:24.905 INFO:teuthology.orchestra.console.smithi113:Power on
2024-01-05T16:42:24.905 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T16:42:24.914 INFO:teuthology.orchestra.console.smithi124:Power on
2024-01-05T16:42:24.914 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T16:42:24.928 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-01-05T16:42:24.928 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:24.939 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2024-01-05T16:42:24.940 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:24.949 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-05T16:42:24.961 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-05T16:42:25.038 INFO:teuthology.orchestra.console.smithi159:Power off
2024-01-05T16:42:25.038 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:42:25.061 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2024-01-05T16:42:25.061 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:25.082 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-05T16:42:25.183 INFO:teuthology.orchestra.console.smithi159:Power off completed
2024-01-05T16:42:25.284 INFO:teuthology.orchestra.console.smithi159:Power on
2024-01-05T16:42:25.284 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T16:42:25.305 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2024-01-05T16:42:25.305 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:25.327 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-05T16:42:28.954 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:28.961 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:29.064 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-05T16:42:29.069 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-05T16:42:29.328 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:29.436 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2024-01-05T16:42:29.537 INFO:teuthology.orchestra.console.smithi159:Power on completed
2024-01-05T16:42:29.637 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2024-01-05T16:42:33.068 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:33.075 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:42:33.184 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-05T16:42:33.284 INFO:teuthology.orchestra.console.smithi124:Power on completed
2024-01-05T16:42:33.310 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-01-05T16:42:33.386 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2024-01-05T16:42:33.411 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-01-05T16:42:33.512 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-01-05T16:45:00.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:01.341 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:45:04.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:04.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:06.944 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:45:07.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:07.420 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:45:10.396 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:45:12.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:13.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:16.028 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:45:16.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:16.476 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:45:19.452 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:45:22.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:22.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:25.088 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:45:25.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:25.532 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:45:25.596 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:45:31.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:31.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:31.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:34.172 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:45:34.591 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:45:34.652 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:45:40.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:40.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:40.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:43.232 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:45:43.644 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:45:43.708 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:45:49.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:49.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:49.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:49.852 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:45:52.316 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:45:52.704 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:45:55.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:58.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:58.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:45:58.908 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:46:01.376 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:46:01.756 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:46:04.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:07.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:07.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:07.964 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:46:10.464 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:46:10.812 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:46:13.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:14.108 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:46:16.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:16.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:19.548 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:46:20.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:22.908 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:46:25.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:28.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:31.964 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:46:37.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:38.245 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:46:38.652 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:46:44.032 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:46:44.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:44.366 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:46:44.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:47.708 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:46:48.444 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:46:50.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:53.084 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:46:53.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:53.836 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:46:55.522 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:46:57.964 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:46:59.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:46:59.212 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:03.338 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:05.051 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:05.639 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:10.464 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:15.176 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:18.758 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:20.588 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:28.265 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:33.715 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:34.875 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:44.392 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:47:49.717 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2024-01-05T16:47:49.719 ERROR:paramiko.transport:Traceback (most recent call last):
2024-01-05T16:47:49.719 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2271, in _check_banner
2024-01-05T16:47:49.719 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2024-01-05T16:47:49.719 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2024-01-05T16:47:49.719 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2024-01-05T16:47:49.719 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout
2024-01-05T16:47:49.719 ERROR:paramiko.transport:    raise EOFError()
2024-01-05T16:47:49.719 ERROR:paramiko.transport:EOFError
2024-01-05T16:47:49.719 ERROR:paramiko.transport:
2024-01-05T16:47:49.719 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2024-01-05T16:47:49.719 ERROR:paramiko.transport:
2024-01-05T16:47:49.720 ERROR:paramiko.transport:Traceback (most recent call last):
2024-01-05T16:47:49.720 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2094, in run
2024-01-05T16:47:49.720 ERROR:paramiko.transport:    self._check_banner()
2024-01-05T16:47:49.720 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2275, in _check_banner
2024-01-05T16:47:49.720 ERROR:paramiko.transport:    raise SSHException(
2024-01-05T16:47:49.720 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2024-01-05T16:47:49.720 ERROR:paramiko.transport:
2024-01-05T16:47:49.720 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: SSHException('Error reading SSH protocol banner') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2271, in _check_banner
    buf = self.packetizer.readline(timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
    buf += self._read_timeout(timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout
    raise EOFError()
EOFError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 421, in connect
    t.start_client(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 699, in start_client
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2094, in run
    self._check_banner()
  File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2275, in _check_banner
    raise SSHException(
paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2024-01-05T16:48:04.156 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:48:08.807 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-05T16:48:10.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:13.212 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:48:19.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:19.356 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:48:20.288 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:48:25.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:26.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:28.412 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:48:28.828 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:48:34.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:34.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:37.471 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:48:37.884 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:48:43.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:43.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:44.028 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:48:46.140 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:48:50.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:52.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:52.636 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:48:53.088 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:48:55.196 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:48:58.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:59.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:01.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:01.696 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:49:02.140 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-05T16:49:04.252 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:49:07.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:08.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:10.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:10.748 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-05T16:49:13.308 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:49:16.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:18.342 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T16:49:18.343 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T16:49:19.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:22.364 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:49:28.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:31.424 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:49:37.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:40.476 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:49:43.670 INFO:teuthology.provision.fog.smithi124:Node is ready
2024-01-05T16:49:43.670 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2024-01-05T16:49:43.694 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2024-01-05T16:49:43.695 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2024-01-05T16:49:43.756 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2024-01-05T16:49:43.756 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2024-01-05T16:49:43.888 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2024-01-05T16:49:43.933 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2024-01-05T16:49:43.961 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2024-01-05T16:49:44.029 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2024-01-05T16:49:44.096 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2024-01-05T16:49:44.153 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2024-01-05T16:49:44.153 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8"
2024-01-05T16:49:44.153 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2024-01-05T16:49:44.153 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:49:44.154 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:49:44.155 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2024-01-05T16:49:44.156 DEBUG:teuthology.parallel:result is None
2024-01-05T16:49:46.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:47.676 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-05T16:49:53.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:08.143 WARNING:teuthology.provision.fog.smithi159:timed out
2024-01-05T16:50:14.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:14.213 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T16:50:14.213 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T16:50:14.284 INFO:teuthology.provision.fog.smithi159:Node is ready
2024-01-05T16:50:14.284 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2024-01-05T16:50:14.344 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159
2024-01-05T16:50:14.344 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159 /etc/hosts
2024-01-05T16:50:14.405 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2024-01-05T16:50:14.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-05T16:50:14.475 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159/smithi159/g' /etc/hosts
2024-01-05T16:50:14.547 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2024-01-05T16:50:14.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159/smithi159/g' /etc/hostname
2024-01-05T16:50:14.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-05T16:50:14.756 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-05T16:50:14.813 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2024-01-05T16:50:14.813 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8"
2024-01-05T16:50:14.813 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2024-01-05T16:50:14.813 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:14.814 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:14.814 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2024-01-05T16:50:14.815 DEBUG:teuthology.parallel:result is None
2024-01-05T16:50:25.428 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T16:50:25.428 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T16:50:50.683 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-01-05T16:50:50.684 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-01-05T16:50:50.707 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com
2024-01-05T16:50:50.707 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts
2024-01-05T16:50:50.769 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113
2024-01-05T16:50:50.770 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-05T16:50:50.903 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts
2024-01-05T16:50:50.933 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts
2024-01-05T16:50:51.003 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname
2024-01-05T16:50:51.074 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-05T16:50:51.142 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:51.200 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:51.201 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:51.201 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:51.201 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:51.201 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-01-05T16:50:51.201 DEBUG:teuthology.parallel:result is None
2024-01-05T16:50:51.399 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-01-05T16:50:51.400 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T16:50:51.429 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2024-01-05T16:50:51.429 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T16:50:51.446 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2024-01-05T16:50:51.446 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T16:50:51.461 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-01-05T16:50:51.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-05T16:50:51.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:51.526 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-01-05T16:50:51.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-05T16:50:51.593 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-01-05T16:50:51.650 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-01-05T16:50:51.650 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-05T16:50:51.707 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-01-05T16:50:51.707 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8"
2024-01-05T16:50:51.707 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-01-05T16:50:51.707 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:51.707 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:51.708 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:51.709 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-05T16:50:51.732 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2024-01-05T16:50:51.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2024-01-05T16:50:51.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:51.798 DEBUG:teuthology.orchestra.run.smithi124:> true
2024-01-05T16:50:51.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2024-01-05T16:50:51.890 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2024-01-05T16:50:51.948 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2024-01-05T16:50:51.948 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2024-01-05T16:50:52.006 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2024-01-05T16:50:52.006 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8"
2024-01-05T16:50:52.006 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2024-01-05T16:50:52.006 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:52.006 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8"
2024-01-05T16:50:52.006 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:52.006 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:52.007 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:52.007 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:52.007 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:52.007 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:52.007 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:52.007 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:52.007 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2024-01-05T16:50:52.042 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2024-01-05T16:50:52.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-05T16:50:52.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:52.109 DEBUG:teuthology.orchestra.run.smithi159:> true
2024-01-05T16:50:52.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-05T16:50:52.252 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2024-01-05T16:50:52.311 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2024-01-05T16:50:52.311 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-05T16:50:52.370 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:52.371 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:52.372 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-05T16:50:52.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T16:50:52.489 INFO:teuthology.dispatcher.supervisor:Running job 7508221
2024-01-05T16:50:52.489 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508221 --name lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi --description rados:thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/reef backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508221/orig.config.yaml
2024-01-05T16:50:52.492 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508221
2024-01-05T16:50:52.492 INFO:teuthology.dispatcher.supervisor:Job PID: 2138701
2024-01-05T16:50:52.492 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-05T16:52:52.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T16:52:52.564 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-05T16:52:52.711 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi113 but it was locked by another job: /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508227
2024-01-05T16:52:52.711 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi124 but it was locked by another job: /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508227
2024-01-05T16:52:52.711 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi159 but it was locked by another job: /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508227