2023-10-26T05:40:44.729 INFO:root:teuthology version: 0.0.1.dev201+g202b180
2023-10-26T05:40:44.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:40:44.933 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f68336b6bb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f68341bb670>, signals=[15])
2023-10-26T05:40:44.934 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2023-10-26T05:40:44.935 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2023-10-26T05:40:44.935 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2023-10-26T05:40:44.957 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2023-10-26T05:40:44.958 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2023-10-26T05:40:44.958 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-10-26T05:40:44.959 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /host {"name": "smithi046"}
2023-10-26T05:40:44.982 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2023-10-26T05:40:44.983 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2023-10-26T05:40:44.983 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2023-10-26T05:40:44.985 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"}
2023-10-26T05:40:45.015 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"}
2023-10-26T05:40:45.026 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-26T05:40:45.061 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-26T05:40:45.064 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-26T05:40:45.064 DEBUG:teuthology.provision.fog.smithi046:FOG request: PUT /host/151 {"imageID": 5}
2023-10-26T05:40:45.093 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-26T05:40:45.099 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-26T05:40:45.099 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 5}
2023-10-26T05:40:45.102 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of rhel 8.6
2023-10-26T05:40:45.103 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:40:45.142 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-26T05:40:45.143 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 5}
2023-10-26T05:40:45.146 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.6
2023-10-26T05:40:45.146 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:40:45.155 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /tasktype {"name": "deploy"}
2023-10-26T05:40:45.190 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.6
2023-10-26T05:40:45.190 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:40:45.198 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"}
2023-10-26T05:40:45.201 DEBUG:teuthology.provision.fog.smithi046:FOG request: POST /host/151/task {"taskTypeID": 1}
2023-10-26T05:40:45.235 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1}
2023-10-26T05:40:45.240 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"}
2023-10-26T05:40:45.271 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1}
2023-10-26T05:40:45.339 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:40:45.355 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:40:45.358 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:40:45.440 INFO:teuthology.orchestra.console.smithi046:Power off
2023-10-26T05:40:45.441 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-26T05:40:45.453 INFO:teuthology.orchestra.console.smithi110:Power off
2023-10-26T05:40:45.454 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-26T05:40:45.466 INFO:teuthology.orchestra.console.smithi152:Power off
2023-10-26T05:40:45.466 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-26T05:40:45.474 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-10-26T05:40:45.475 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:45.482 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2023-10-26T05:40:45.482 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:45.490 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2023-10-26T05:40:45.491 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:45.499 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-26T05:40:45.502 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2023-10-26T05:40:45.512 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-26T05:40:45.600 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-10-26T05:40:45.605 INFO:teuthology.orchestra.console.smithi046:Power off completed
2023-10-26T05:40:45.613 INFO:teuthology.orchestra.console.smithi152:Power off completed
2023-10-26T05:40:45.701 INFO:teuthology.orchestra.console.smithi110:Power on
2023-10-26T05:40:45.702 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-26T05:40:45.709 INFO:teuthology.orchestra.console.smithi046:Power on
2023-10-26T05:40:45.710 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-26T05:40:45.716 INFO:teuthology.orchestra.console.smithi152:Power on
2023-10-26T05:40:45.717 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-26T05:40:45.725 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On
2023-10-26T05:40:45.725 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:45.733 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On
2023-10-26T05:40:45.734 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:45.742 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2023-10-26T05:40:45.743 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:45.752 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-26T05:40:45.756 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2023-10-26T05:40:45.764 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-26T05:40:49.757 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:49.765 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:49.773 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:49.868 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-26T05:40:49.874 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2023-10-26T05:40:49.882 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-26T05:40:53.872 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:53.879 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:53.886 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T05:40:53.981 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-10-26T05:40:53.987 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2023-10-26T05:40:53.994 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-10-26T05:40:54.083 INFO:teuthology.orchestra.console.smithi110:Power on completed
2023-10-26T05:40:54.088 INFO:teuthology.orchestra.console.smithi046:Power on completed
2023-10-26T05:40:54.095 INFO:teuthology.orchestra.console.smithi152:Power on completed
2023-10-26T05:40:54.184 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2023-10-26T05:40:54.185 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:40:54.189 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2023-10-26T05:40:54.189 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:40:54.196 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2023-10-26T05:40:54.197 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:41:09.266 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:41:09.268 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:41:09.272 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:41:24.346 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:41:24.348 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:41:24.349 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:41:39.425 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:41:39.427 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:41:39.428 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:41:54.498 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:41:54.500 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:41:54.501 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:42:09.574 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:42:09.576 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:42:09.577 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:42:24.654 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:42:24.656 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:42:24.657 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:42:39.726 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:42:39.728 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:42:39.732 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:42:54.810 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:42:54.812 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:42:54.813 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:43:09.888 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:43:09.890 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:43:09.891 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:43:24.974 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:43:24.984 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None
2023-10-26T05:43:24.986 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:43:25.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:43:25.126 ERROR:teuthology.orchestra.connection:Error authenticating with smithi046.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-10-26T05:43:39.386 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2023-10-26T05:43:40.048 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-26T05:43:40.051 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-26T05:43:40.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:43:40.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:43:45.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:43:48.445 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2023-10-26T05:43:54.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:43:57.498 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2023-10-26T05:43:58.590 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-26T05:43:58.591 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-26T05:44:03.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:04.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:04.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:06.558 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2023-10-26T05:44:07.642 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-26T05:44:07.674 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-26T05:44:12.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:13.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:13.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:15.614 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2023-10-26T05:44:16.702 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-26T05:44:16.730 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-26T05:44:21.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:22.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:22.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:24.666 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2023-10-26T05:44:25.757 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-26T05:44:25.786 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-26T05:44:30.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:31.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:31.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:44:34.810 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-26T05:44:40.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:45:30.671 WARNING:teuthology.provision.fog.smithi046:timed out
2023-10-26T05:45:31.789 WARNING:teuthology.provision.fog.smithi110:timed out
2023-10-26T05:45:36.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:45:37.001 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-26T05:45:37.002 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-26T05:45:37.270 INFO:teuthology.provision.fog.smithi046:Node is ready
2023-10-26T05:45:37.270 DEBUG:teuthology.orchestra.run.smithi046:> hostname
2023-10-26T05:45:37.288 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com
2023-10-26T05:45:37.289 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts
2023-10-26T05:45:37.348 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2023-10-26T05:45:37.348 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2023-10-26T05:45:37.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts
2023-10-26T05:45:37.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts
2023-10-26T05:45:37.572 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname
2023-10-26T05:45:37.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2023-10-26T05:45:37.707 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2023-10-26T05:45:37.764 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux"
2023-10-26T05:45:37.764 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)"
2023-10-26T05:45:37.764 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel"
2023-10-26T05:45:37.765 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora"
2023-10-26T05:45:37.765 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6"
2023-10-26T05:45:37.765 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8"
2023-10-26T05:45:37.765 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-26T05:45:37.765 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2023-10-26T05:45:37.766 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-26T05:45:37.766 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/"
2023-10-26T05:45:37.766 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-26T05:45:37.766 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-26T05:45:37.766 INFO:teuthology.orchestra.run.smithi046.stdout:
2023-10-26T05:45:37.766 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-26T05:45:37.767 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-26T05:45:37.767 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-26T05:45:37.767 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-26T05:45:37.768 INFO:teuthology.provision.fog.smithi046:Deploy complete!
2023-10-26T05:45:37.769 DEBUG:teuthology.parallel:result is None
2023-10-26T05:45:37.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:45:38.128 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-26T05:45:38.128 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-26T05:45:38.434 INFO:teuthology.provision.fog.smithi110:Node is ready
2023-10-26T05:45:38.435 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2023-10-26T05:45:38.453 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2023-10-26T05:45:38.453 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2023-10-26T05:45:38.511 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2023-10-26T05:45:38.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-10-26T05:45:38.639 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2023-10-26T05:45:38.668 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2023-10-26T05:45:38.737 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2023-10-26T05:45:38.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-10-26T05:45:38.872 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-10-26T05:45:38.929 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux"
2023-10-26T05:45:38.929 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)"
2023-10-26T05:45:38.929 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel"
2023-10-26T05:45:38.930 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora"
2023-10-26T05:45:38.930 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6"
2023-10-26T05:45:38.930 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8"
2023-10-26T05:45:38.930 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-26T05:45:38.930 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-10-26T05:45:38.931 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-26T05:45:38.931 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/"
2023-10-26T05:45:38.931 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-26T05:45:38.931 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-26T05:45:38.931 INFO:teuthology.orchestra.run.smithi110.stdout:
2023-10-26T05:45:38.932 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-26T05:45:38.932 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-26T05:45:38.932 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-26T05:45:38.932 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-26T05:45:38.932 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2023-10-26T05:45:38.933 DEBUG:teuthology.parallel:result is None
2023-10-26T05:45:40.814 WARNING:teuthology.provision.fog.smithi152:timed out
2023-10-26T05:45:46.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:45:47.152 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-26T05:45:47.153 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-26T05:45:47.444 INFO:teuthology.provision.fog.smithi152:Node is ready
2023-10-26T05:45:47.444 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2023-10-26T05:45:47.461 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2023-10-26T05:45:47.462 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts
2023-10-26T05:45:47.520 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2023-10-26T05:45:47.520 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2023-10-26T05:45:47.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts
2023-10-26T05:45:47.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts
2023-10-26T05:45:47.734 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname
2023-10-26T05:45:47.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2023-10-26T05:45:47.867 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2023-10-26T05:45:47.923 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux"
2023-10-26T05:45:47.923 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)"
2023-10-26T05:45:47.923 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel"
2023-10-26T05:45:47.924 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora"
2023-10-26T05:45:47.924 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6"
2023-10-26T05:45:47.924 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2023-10-26T05:45:47.924 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-26T05:45:47.924 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2023-10-26T05:45:47.925 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-26T05:45:47.925 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/"
2023-10-26T05:45:47.925 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-26T05:45:47.925 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-26T05:45:47.925 INFO:teuthology.orchestra.run.smithi152.stdout:
2023-10-26T05:45:47.926 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-26T05:45:47.926 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-26T05:45:47.926 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-26T05:45:47.926 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-26T05:45:47.927 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2023-10-26T05:45:47.927 DEBUG:teuthology.parallel:result is None
2023-10-26T05:45:48.111 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com
2023-10-26T05:45:48.111 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-26T05:45:48.138 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2023-10-26T05:45:48.139 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-26T05:45:48.155 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2023-10-26T05:45:48.155 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-26T05:45:48.172 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server
2023-10-26T05:45:48.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com'
2023-10-26T05:45:48.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:45:48.241 DEBUG:teuthology.orchestra.run.smithi046:> true
2023-10-26T05:45:48.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com'
2023-10-26T05:45:48.377 DEBUG:teuthology.orchestra.run.smithi046:> uname -m
2023-10-26T05:45:48.437 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64
2023-10-26T05:45:48.438 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2023-10-26T05:45:48.496 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux"
2023-10-26T05:45:48.497 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)"
2023-10-26T05:45:48.497 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel"
2023-10-26T05:45:48.497 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora"
2023-10-26T05:45:48.497 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6"
2023-10-26T05:45:48.497 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8"
2023-10-26T05:45:48.498 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-26T05:45:48.498 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2023-10-26T05:45:48.498 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-26T05:45:48.498 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/"
2023-10-26T05:45:48.498 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-26T05:45:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-26T05:45:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:
2023-10-26T05:45:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-26T05:45:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-26T05:45:48.499 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-26T05:45:48.500 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-26T05:45:48.500 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2023-10-26T05:45:48.521 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2023-10-26T05:45:48.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-10-26T05:45:48.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:45:48.590 DEBUG:teuthology.orchestra.run.smithi110:> true
2023-10-26T05:45:48.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-10-26T05:45:48.662 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2023-10-26T05:45:48.720 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2023-10-26T05:45:48.721 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-10-26T05:45:48.779 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux"
2023-10-26T05:45:48.779 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)"
2023-10-26T05:45:48.779 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel"
2023-10-26T05:45:48.780 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora"
2023-10-26T05:45:48.780 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6"
2023-10-26T05:45:48.780 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8"
2023-10-26T05:45:48.780 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-26T05:45:48.780 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-10-26T05:45:48.781 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-26T05:45:48.781 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/"
2023-10-26T05:45:48.781 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-26T05:45:48.781 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-26T05:45:48.781 INFO:teuthology.orchestra.run.smithi110.stdout:
2023-10-26T05:45:48.782 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-26T05:45:48.782 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-26T05:45:48.782 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-26T05:45:48.782 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-26T05:45:48.783 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-10-26T05:45:48.813 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2023-10-26T05:45:48.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2023-10-26T05:45:48.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-26T05:45:48.885 DEBUG:teuthology.orchestra.run.smithi152:> true
2023-10-26T05:45:48.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2023-10-26T05:45:48.952 DEBUG:teuthology.orchestra.run.smithi152:> uname -m
2023-10-26T05:45:49.014 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2023-10-26T05:45:49.014 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2023-10-26T05:45:49.076 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux"
2023-10-26T05:45:49.077 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)"
2023-10-26T05:45:49.077 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel"
2023-10-26T05:45:49.077 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora"
2023-10-26T05:45:49.077 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6"
2023-10-26T05:45:49.077 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2023-10-26T05:45:49.078 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-26T05:45:49.078 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2023-10-26T05:45:49.078 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-26T05:45:49.078 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/"
2023-10-26T05:45:49.078 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-26T05:45:49.079 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-26T05:45:49.079 INFO:teuthology.orchestra.run.smithi152.stdout:
2023-10-26T05:45:49.079 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-26T05:45:49.079 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-26T05:45:49.079 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-26T05:45:49.079 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-26T05:45:49.080 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2023-10-26T05:45:49.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:45:49.201 INFO:teuthology.dispatcher.supervisor:Running job 7438454
2023-10-26T05:45:49.202 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438454 --name pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438454/orig.config.yaml
2023-10-26T05:45:49.204 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438454
2023-10-26T05:45:49.205 INFO:teuthology.dispatcher.supervisor:Job PID: 894911
2023-10-26T05:45:49.205 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-26T05:47:49.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:49:49.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:51:49.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:53:49.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:55:49.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:57:49.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T05:59:49.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:01:49.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:03:49.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:05:49.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:07:49.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:09:50.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:11:50.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:13:50.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:15:50.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:17:50.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:19:50.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-26T06:19:50.483 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-26T06:19:50.776 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-26T06:19:50.776 INFO:teuthology.nuke:Checking targets against current locks
2023-10-26T06:19:50.819 DEBUG:teuthology.nuke:shortname: smithi046
2023-10-26T06:19:50.820 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-26T06:19:50.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 05:40:43.858895', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-26T06:19:50.852 DEBUG:teuthology.nuke:shortname: smithi110
2023-10-26T06:19:50.853 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-26T06:19:50.877 DEBUG:teuthology.nuke:shortname: smithi152
2023-10-26T06:19:50.878 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-26T06:19:50.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 05:40:43.856173', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-26T06:19:50.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 05:40:43.857679', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-26T06:19:50.913 INFO:teuthology.orchestra.console.smithi046:Power off
2023-10-26T06:19:50.914 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-26T06:19:50.935 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2023-10-26T06:19:50.936 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T06:19:50.952 INFO:teuthology.orchestra.console.smithi110:Power off
2023-10-26T06:19:50.953 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-26T06:19:50.965 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2023-10-26T06:19:50.973 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-10-26T06:19:50.973 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T06:19:50.992 INFO:teuthology.orchestra.console.smithi152:Power off
2023-10-26T06:19:50.993 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-26T06:19:51.001 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-26T06:19:51.015 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2023-10-26T06:19:51.015 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-26T06:19:51.036 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-26T06:19:51.066 INFO:teuthology.orchestra.console.smithi046:Power off completed
2023-10-26T06:19:51.103 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-10-26T06:19:51.138 INFO:teuthology.orchestra.console.smithi152:Power off completed
2023-10-26T06:19:51.232 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com
2023-10-26T06:19:51.248 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2023-10-26T06:19:51.291 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com