2024-03-24T10:19:40.326 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-24T10:19:40.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:19:40.564 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa72ab8ef70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa72bbefc10>, signals=[15])
2024-03-24T10:19:40.564 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2024-03-24T10:19:40.565 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T10:19:40.565 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-03-24T10:19:40.585 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-03-24T10:19:40.586 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T10:19:40.586 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-24T10:19:40.610 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2024-03-24T10:19:40.610 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T10:19:40.610 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-03-24T10:19:40.635 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2024-03-24T10:19:40.635 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T10:19:40.635 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-24T10:19:40.709 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-24T10:19:40.713 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-24T10:19:40.753 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 22.04
2024-03-24T10:19:40.755 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 22.04
2024-03-24T10:19:40.774 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-24T10:19:40.779 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-24T10:19:40.833 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of ubuntu 22.04
2024-03-24T10:19:40.836 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of ubuntu 22.04
2024-03-24T10:19:41.416 INFO:teuthology.orchestra.console.smithi099:Power off
2024-03-24T10:19:41.416 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T10:19:41.437 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2024-03-24T10:19:41.437 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:41.457 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-03-24T10:19:41.463 INFO:teuthology.orchestra.console.smithi100:Power off
2024-03-24T10:19:41.463 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T10:19:41.484 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-03-24T10:19:41.484 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:41.504 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-24T10:19:41.551 INFO:teuthology.orchestra.console.smithi105:Power off
2024-03-24T10:19:41.552 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T10:19:41.558 INFO:teuthology.orchestra.console.smithi099:Power off completed
2024-03-24T10:19:41.564 INFO:teuthology.orchestra.console.smithi102:Power off
2024-03-24T10:19:41.564 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T10:19:41.572 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2024-03-24T10:19:41.573 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:41.587 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-03-24T10:19:41.587 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:41.595 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-24T10:19:41.606 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-03-24T10:19:41.608 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-24T10:19:41.659 INFO:teuthology.orchestra.console.smithi099:Power on
2024-03-24T10:19:41.659 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T10:19:41.680 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2024-03-24T10:19:41.681 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:41.696 INFO:teuthology.orchestra.console.smithi105:Power off completed
2024-03-24T10:19:41.702 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-03-24T10:19:41.706 INFO:teuthology.orchestra.console.smithi100:Power on
2024-03-24T10:19:41.706 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T10:19:41.729 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-03-24T10:19:41.730 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:41.750 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-24T10:19:41.797 INFO:teuthology.orchestra.console.smithi105:Power on
2024-03-24T10:19:41.797 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T10:19:41.818 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2024-03-24T10:19:41.818 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:41.839 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-24T10:19:45.612 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:45.703 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:45.724 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-24T10:19:45.750 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:45.813 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-03-24T10:19:45.840 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:45.860 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-24T10:19:45.948 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-24T10:19:49.727 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:49.814 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:49.836 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-24T10:19:49.861 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:49.923 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-03-24T10:19:49.950 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:49.968 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-24T10:19:50.024 INFO:teuthology.orchestra.console.smithi099:Power on completed
2024-03-24T10:19:50.069 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-03-24T10:19:50.087 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-24T10:19:50.124 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2024-03-24T10:19:50.170 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-03-24T10:19:50.188 INFO:teuthology.orchestra.console.smithi105:Power on completed
2024-03-24T10:19:50.289 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2024-03-24T10:19:50.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:19:50.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:19:53.374 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:19:53.838 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:53.947 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-03-24T10:19:54.048 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-03-24T10:19:54.149 INFO:teuthology.orchestra.console.smithi102:Power on
2024-03-24T10:19:54.149 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T10:19:54.169 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2024-03-24T10:19:54.169 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:54.189 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-03-24T10:19:58.190 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:19:58.299 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-24T10:19:58.400 INFO:teuthology.orchestra.console.smithi102:Power on completed
2024-03-24T10:19:58.501 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2024-03-24T10:19:58.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:19:59.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:02.430 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:20:08.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:08.862 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:20:11.486 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:20:14.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:17.314 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:20:17.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:17.918 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:20:20.542 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:20:23.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:23.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:26.399 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:20:26.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:26.974 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:20:29.598 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:20:32.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:32.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:35.454 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:20:35.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:36.030 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:20:38.654 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:20:41.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:42.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:44.510 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:20:44.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:45.086 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:20:47.714 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:20:50.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:51.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:53.566 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:20:53.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:54.142 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:20:56.770 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:20:59.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:00.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:02.622 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:21:02.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:06.242 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:21:08.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:12.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:13.118 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:21:15.326 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:21:19.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:21.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:21.546 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:21:22.174 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:21:26.942 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:21:27.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:27.680 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:28.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:28.305 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:31.772 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:32.434 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:32.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:35.998 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:21:38.904 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:39.563 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:41.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:42.131 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:46.263 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:49.035 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:49.695 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:21:53.397 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:02.168 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:02.825 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:03.528 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:16.662 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:18.303 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:18.956 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:32.796 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:37.435 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:38.089 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:51.893 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:22:59.528 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:00.180 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:13.988 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:24.621 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:25.271 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:39.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:52.713 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:52.714 WARNING:teuthology.provision.fog.smithi105:'connect to smithi105.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-03-24T10:23:53.401 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:53.402 WARNING:teuthology.provision.fog.smithi100:'connect to smithi100.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-03-24T10:23:58.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:23:59.017 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:23:59.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:23:59.698 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:24:07.181 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-24T10:24:07.181 WARNING:teuthology.provision.fog.smithi102:'connect to smithi102.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-03-24T10:24:13.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:24:24.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:24:27.742 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:24:33.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:24:36.802 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:24:42.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:24:45.854 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:24:51.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:24:54.910 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:25:00.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:03.020 WARNING:teuthology.provision.fog.smithi105:timed out
2024-03-24T10:25:03.702 WARNING:teuthology.provision.fog.smithi100:timed out
2024-03-24T10:25:03.966 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:25:09.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:09.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:09.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:13.022 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:25:13.184 WARNING:teuthology.provision.fog.smithi102:timed out
2024-03-24T10:25:19.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:19.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:25.342 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:25:27.582 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:25:31.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:33.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:34.398 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:25:34.594 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:25:37.566 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:25:40.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:40.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:40.597 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:25:42.121 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:25:43.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:46.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:46.599 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:25:46.622 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:25:48.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:48.124 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:25:50.622 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:25:52.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:52.603 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:25:52.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:52.625 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:25:54.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:54.126 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:25:56.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:56.625 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:25:58.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:58.606 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-24T10:25:58.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:25:58.628 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:26:00.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:00.129 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:26:02.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:02.629 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:26:04.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:04.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:04.680 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:26:04.690 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T10:26:04.690 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T10:26:04.810 INFO:teuthology.provision.fog.smithi105:Node is ready
2024-03-24T10:26:04.810 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2024-03-24T10:26:04.859 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105
2024-03-24T10:26:04.860 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105 /etc/hosts
2024-03-24T10:26:04.908 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105 smithi105
2024-03-24T10:26:04.908 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-24T10:26:04.963 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105/smithi105/g' /etc/hosts
2024-03-24T10:26:05.019 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2024-03-24T10:26:05.076 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105/smithi105/g' /etc/hostname
2024-03-24T10:26:05.132 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-24T10:26:05.187 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu"
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="22.04"
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:05.236 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:05.237 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:05.237 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2024-03-24T10:26:05.238 DEBUG:teuthology.parallel:result is None
2024-03-24T10:26:06.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:06.131 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-24T10:26:08.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:08.632 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:26:10.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:10.682 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-24T10:26:12.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:12.216 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T10:26:12.217 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T10:26:12.322 INFO:teuthology.provision.fog.smithi100:Node is ready
2024-03-24T10:26:12.322 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2024-03-24T10:26:12.368 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100
2024-03-24T10:26:12.368 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100 /etc/hosts
2024-03-24T10:26:12.416 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100 smithi100
2024-03-24T10:26:12.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-24T10:26:12.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100/smithi100/g' /etc/hosts
2024-03-24T10:26:12.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2024-03-24T10:26:12.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100/smithi100/g' /etc/hostname
2024-03-24T10:26:12.640 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-24T10:26:12.696 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-24T10:26:12.744 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:12.744 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2024-03-24T10:26:12.744 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04"
2024-03-24T10:26:12.744 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:12.745 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2024-03-24T10:26:12.746 DEBUG:teuthology.parallel:result is None
2024-03-24T10:26:14.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:14.635 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-24T10:26:16.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:16.900 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T10:26:16.900 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T10:26:17.306 INFO:teuthology.provision.fog.smithi102:Node is ready
2024-03-24T10:26:17.306 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2024-03-24T10:26:17.353 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2024-03-24T10:26:17.354 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2024-03-24T10:26:17.402 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2024-03-24T10:26:17.402 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-03-24T10:26:17.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2024-03-24T10:26:17.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2024-03-24T10:26:17.635 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2024-03-24T10:26:17.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-03-24T10:26:17.743 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-03-24T10:26:17.794 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:17.794 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu"
2024-03-24T10:26:17.794 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04"
2024-03-24T10:26:17.795 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:17.795 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:17.795 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu
2024-03-24T10:26:17.795 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian
2024-03-24T10:26:17.795 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:17.795 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:17.798 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:17.798 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:17.798 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:17.798 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2024-03-24T10:26:17.798 DEBUG:teuthology.parallel:result is None
2024-03-24T10:26:20.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:20.921 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T10:26:20.921 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T10:26:21.406 INFO:teuthology.provision.fog.smithi099:Node is ready
2024-03-24T10:26:21.407 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2024-03-24T10:26:21.452 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2024-03-24T10:26:21.452 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2024-03-24T10:26:21.500 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2024-03-24T10:26:21.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-03-24T10:26:21.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2024-03-24T10:26:21.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2024-03-24T10:26:21.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2024-03-24T10:26:21.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-03-24T10:26:21.814 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-03-24T10:26:21.859 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:21.859 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu"
2024-03-24T10:26:21.859 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04"
2024-03-24T10:26:21.859 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:21.860 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:21.860 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2024-03-24T10:26:21.861 DEBUG:teuthology.parallel:result is None
2024-03-24T10:26:22.178 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2024-03-24T10:26:22.179 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T10:26:22.212 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2024-03-24T10:26:22.212 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2024-03-24T10:26:22.212 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2024-03-24T10:26:22.214 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2024-03-24T10:26:22.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-03-24T10:26:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:22.291 DEBUG:teuthology.orchestra.run.smithi099:> true
2024-03-24T10:26:22.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-03-24T10:26:22.383 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2024-03-24T10:26:22.427 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2024-03-24T10:26:22.428 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu"
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04"
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:22.476 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:22.476 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:22.476 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-03-24T10:26:22.504 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2024-03-24T10:26:22.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-24T10:26:22.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:22.578 DEBUG:teuthology.orchestra.run.smithi100:> true
2024-03-24T10:26:22.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-24T10:26:22.698 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2024-03-24T10:26:22.744 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2024-03-24T10:26:22.744 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-24T10:26:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2024-03-24T10:26:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04"
2024-03-24T10:26:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2024-03-24T10:26:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2024-03-24T10:26:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:22.798 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-24T10:26:22.829 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2024-03-24T10:26:22.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-03-24T10:26:22.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:22.906 DEBUG:teuthology.orchestra.run.smithi102:> true
2024-03-24T10:26:22.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-03-24T10:26:22.994 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2024-03-24T10:26:23.045 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2024-03-24T10:26:23.045 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu"
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04"
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:23.094 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:23.095 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:23.095 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:23.095 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-03-24T10:26:23.120 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2024-03-24T10:26:23.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-24T10:26:23.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:26:23.197 DEBUG:teuthology.orchestra.run.smithi105:> true
2024-03-24T10:26:23.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-24T10:26:23.290 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2024-03-24T10:26:23.339 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2024-03-24T10:26:23.340 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-24T10:26:23.387 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-24T10:26:23.387 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu"
2024-03-24T10:26:23.387 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="22.04"
2024-03-24T10:26:23.387 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-24T10:26:23.387 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=jammy
2024-03-24T10:26:23.387 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu
2024-03-24T10:26:23.388 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian
2024-03-24T10:26:23.388 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-24T10:26:23.388 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-24T10:26:23.388 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-24T10:26:23.388 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-24T10:26:23.388 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=jammy
2024-03-24T10:26:23.388 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-24T10:26:23.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:26:23.501 INFO:teuthology.dispatcher.supervisor:Running job 7619276
2024-03-24T10:26:23.501 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2024-03-24_06:22:00-rados:thrash-wip-rf-qtimeout-distro-default-smithi/7619276 --name rfriedma-2024-03-24_06:22:00-rados:thrash-wip-rf-qtimeout-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/archive/rfriedma-2024-03-24_06:22:00-rados:thrash-wip-rf-qtimeout-distro-default-smithi/7619276/orig.config.yaml
2024-03-24T10:26:23.504 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2024-03-24_06:22:00-rados:thrash-wip-rf-qtimeout-distro-default-smithi/7619276
2024-03-24T10:26:23.505 INFO:teuthology.dispatcher.supervisor:Job PID: 3734430
2024-03-24T10:26:23.505 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-24T10:28:23.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:28:23.591 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-03-24T10:28:23.748 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi100 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-03-24_06:22:00-rados:thrash-wip-rf-qtimeout-distro-default-smithi/7619296
2024-03-24T10:28:23.748 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi102 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-03-24_06:22:00-rados:thrash-wip-rf-qtimeout-distro-default-smithi/7619296
2024-03-24T10:28:23.748 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-03-24_06:22:00-rados:thrash-wip-rf-qtimeout-distro-default-smithi/7619296