2024-04-10T20:26:36.056 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-10T20:26:36.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T20:26:36.265 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd863bbcf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd864c1dc10>, signals=[15])
2024-04-10T20:26:36.265 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2024-04-10T20:26:36.265 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T20:26:36.265 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-04-10T20:26:36.299 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2024-04-10T20:26:36.299 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T20:26:36.299 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-04-10T20:26:36.340 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging
2024-04-10T20:26:36.340 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T20:26:36.341 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2024-04-10T20:26:36.499 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-10T20:26:36.542 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-10T20:26:36.559 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 22.04
2024-04-10T20:26:36.559 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-10T20:26:36.640 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 22.04
2024-04-10T20:26:36.654 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of ubuntu 22.04
2024-04-10T20:26:37.183 INFO:teuthology.orchestra.console.smithi046:Power off
2024-04-10T20:26:37.183 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T20:26:37.227 INFO:teuthology.orchestra.console.smithi162:Power off
2024-04-10T20:26:37.228 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T20:26:37.236 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-04-10T20:26:37.236 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:37.262 INFO:teuthology.orchestra.console.smithi142:Power off
2024-04-10T20:26:37.262 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T20:26:37.271 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-04-10T20:26:37.282 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off
2024-04-10T20:26:37.282 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:37.313 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-04-10T20:26:37.313 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:37.331 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2024-04-10T20:26:37.347 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-10T20:26:37.372 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-04-10T20:26:37.432 INFO:teuthology.orchestra.console.smithi162:Power off completed
2024-04-10T20:26:37.448 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-04-10T20:26:37.473 INFO:teuthology.orchestra.console.smithi046:Power on
2024-04-10T20:26:37.473 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T20:26:37.508 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On
2024-04-10T20:26:37.558 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:37.565 INFO:teuthology.orchestra.console.smithi162:Power on
2024-04-10T20:26:37.565 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T20:26:37.572 INFO:teuthology.orchestra.console.smithi142:Power on
2024-04-10T20:26:37.573 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T20:26:37.601 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On
2024-04-10T20:26:37.601 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:37.609 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2024-04-10T20:26:37.609 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:37.617 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-04-10T20:26:37.634 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2024-04-10T20:26:37.644 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-10T20:26:41.622 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:41.635 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:41.645 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:41.731 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-04-10T20:26:41.742 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-04-10T20:26:41.753 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-10T20:26:41.844 INFO:teuthology.orchestra.console.smithi162:Power on completed
2024-04-10T20:26:41.944 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2024-04-10T20:26:45.736 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:45.754 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T20:26:45.848 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-04-10T20:26:45.867 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-04-10T20:26:45.949 INFO:teuthology.orchestra.console.smithi046:Power on completed
2024-04-10T20:26:45.968 INFO:teuthology.orchestra.console.smithi142:Power on completed
2024-04-10T20:26:46.050 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2024-04-10T20:26:46.069 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2024-04-10T20:26:46.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:26:49.310 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:26:55.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:26:58.398 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:27:04.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:27:07.486 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:27:13.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:27:16.574 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:27:22.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:27:25.666 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:27:31.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:27:34.750 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:27:40.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:27:43.838 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:27:49.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:27:52.926 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:27:58.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:28:09.118 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:28:15.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:28:18.206 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:28:24.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:28:24.657 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:28:30.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:28:30.825 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:28:34.968 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:28:42.111 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:28:52.255 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:29:05.399 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:29:21.547 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:29:40.704 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:30:02.847 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:30:27.958 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:30:56.116 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:30:56.117 WARNING:teuthology.provision.fog.smithi142:'connect to smithi142.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-04-10T20:31:00.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:02.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:02.292 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T20:31:03.390 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-10T20:31:09.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:12.478 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-10T20:31:18.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:21.566 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-10T20:31:27.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:30.654 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-10T20:31:36.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:39.746 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-10T20:31:45.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:48.830 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-10T20:31:54.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:31:57.918 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-10T20:32:03.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:04.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:06.332 WARNING:teuthology.provision.fog.smithi142:timed out
2024-04-10T20:32:08.031 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-04-10T20:32:12.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:14.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:17.150 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-04-10T20:32:23.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:26.238 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-04-10T20:32:28.542 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:32:32.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:34.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:34.558 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:32:35.326 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-04-10T20:32:40.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:41.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:43.423 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:32:44.414 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-04-10T20:32:49.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:49.437 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:32:50.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:53.502 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-04-10T20:32:55.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:32:55.455 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:32:59.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:33:01.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:33:01.486 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:33:02.590 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-04-10T20:33:03.956 WARNING:teuthology.provision.fog.smithi162:timed out
2024-04-10T20:33:07.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:33:07.502 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-10T20:33:08.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:33:09.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:33:10.213 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T20:33:10.213 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T20:33:10.627 INFO:teuthology.provision.fog.smithi162:Node is ready
2024-04-10T20:33:10.627 DEBUG:teuthology.orchestra.run.smithi162:> hostname
2024-04-10T20:33:10.675 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2024-04-10T20:33:10.676 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts
2024-04-10T20:33:10.724 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2024-04-10T20:33:10.724 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2024-04-10T20:33:10.845 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts
2024-04-10T20:33:10.859 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts
2024-04-10T20:33:10.915 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname
2024-04-10T20:33:10.971 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2024-04-10T20:33:11.026 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T20:33:11.072 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy
2024-04-10T20:33:11.073 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2024-04-10T20:33:11.074 DEBUG:teuthology.parallel:result is None
2024-04-10T20:33:13.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:33:13.697 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T20:33:13.698 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T20:33:14.203 INFO:teuthology.provision.fog.smithi142:Node is ready
2024-04-10T20:33:14.203 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2024-04-10T20:33:14.249 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2024-04-10T20:33:14.249 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts
2024-04-10T20:33:14.297 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2024-04-10T20:33:14.297 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-10T20:33:14.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts
2024-04-10T20:33:14.453 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2024-04-10T20:33:14.512 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname
2024-04-10T20:33:14.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-10T20:33:14.622 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-04-10T20:33:14.672 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T20:33:14.672 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu"
2024-04-10T20:33:14.672 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04"
2024-04-10T20:33:14.672 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T20:33:14.672 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy
2024-04-10T20:33:14.672 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu
2024-04-10T20:33:14.673 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian
2024-04-10T20:33:14.673 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T20:33:14.673 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T20:33:14.673 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T20:33:14.673 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T20:33:14.673 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy
2024-04-10T20:33:14.673 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2024-04-10T20:33:14.674 DEBUG:teuthology.parallel:result is None
2024-04-10T20:34:08.605 WARNING:teuthology.provision.fog.smithi046:timed out
2024-04-10T20:34:14.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:34:14.796 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T20:34:14.796 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T20:34:15.352 INFO:teuthology.provision.fog.smithi046:Node is ready
2024-04-10T20:34:15.353 DEBUG:teuthology.orchestra.run.smithi046:> hostname
2024-04-10T20:34:15.400 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com
2024-04-10T20:34:15.400 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts
2024-04-10T20:34:15.448 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-04-10T20:34:15.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-04-10T20:34:15.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts
2024-04-10T20:34:15.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts
2024-04-10T20:34:15.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname
2024-04-10T20:34:15.688 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-04-10T20:34:15.743 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-04-10T20:34:15.791 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu"
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04"
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T20:34:15.792 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T20:34:15.793 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T20:34:15.793 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy
2024-04-10T20:34:15.793 INFO:teuthology.provision.fog.smithi046:Deploy complete!
2024-04-10T20:34:15.794 DEBUG:teuthology.parallel:result is None
2024-04-10T20:34:16.214 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com
2024-04-10T20:34:16.215 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T20:34:16.250 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2024-04-10T20:34:16.250 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T20:34:16.283 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2024-04-10T20:34:16.283 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T20:34:16.318 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server
2024-04-10T20:34:16.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-04-10T20:34:16.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:34:16.405 DEBUG:teuthology.orchestra.run.smithi046:> true
2024-04-10T20:34:16.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-04-10T20:34:16.510 DEBUG:teuthology.orchestra.run.smithi046:> uname -m
2024-04-10T20:34:16.554 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64
2024-04-10T20:34:16.554 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-04-10T20:34:16.602 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T20:34:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy
2024-04-10T20:34:16.604 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-04-10T20:34:16.633 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2024-04-10T20:34:16.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-04-10T20:34:16.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:34:16.720 DEBUG:teuthology.orchestra.run.smithi142:> true
2024-04-10T20:34:16.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-04-10T20:34:16.950 DEBUG:teuthology.orchestra.run.smithi142:> uname -m
2024-04-10T20:34:16.996 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2024-04-10T20:34:16.997 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-04-10T20:34:17.044 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T20:34:17.045 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy
2024-04-10T20:34:17.046 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-04-10T20:34:17.075 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2024-04-10T20:34:17.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2024-04-10T20:34:17.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T20:34:17.165 DEBUG:teuthology.orchestra.run.smithi162:> true
2024-04-10T20:34:17.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com'
2024-04-10T20:34:17.382 DEBUG:teuthology.orchestra.run.smithi162:> uname -m
2024-04-10T20:34:17.431 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2024-04-10T20:34:17.431 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu"
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04"
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T20:34:17.480 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T20:34:17.481 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy
2024-04-10T20:34:17.481 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2024-04-10T20:34:17.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T20:34:17.628 INFO:teuthology.dispatcher.supervisor:Running job 7651201
2024-04-10T20:34:17.628 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651201 --name yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi --description rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} -- /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651201/orig.config.yaml
2024-04-10T20:34:17.631 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651201
2024-04-10T20:34:17.631 INFO:teuthology.dispatcher.supervisor:Job PID: 3339365
2024-04-10T20:34:17.631 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-10T20:36:17.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T20:38:17.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T20:38:17.792 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-04-10T20:38:17.911 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651202