2023-08-15T22:38:50.532 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T22:38:50.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:38:50.712 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa88c28b280>, signals=[15]) 2023-08-15T22:38:50.714 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-08-15T22:38:50.714 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:38:50.715 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-08-15T22:38:50.743 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-08-15T22:38:50.743 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:38:50.743 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-15T22:38:50.745 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-08-15T22:38:57.975 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-08-15T22:38:57.975 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:38:57.975 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-08-15T22:38:57.977 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-08-15T22:39:17.998 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-08-15T22:39:23.032 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T22:39:28.041 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T22:39:38.071 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T22:39:43.078 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T22:39:43.079 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 7} 2023-08-15T22:39:43.080 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T22:39:43.080 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 7} 2023-08-15T22:39:53.148 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.4 2023-08-15T22:39:53.148 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:39:53.152 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T22:39:53.152 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 7} 2023-08-15T22:39:53.153 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.4 2023-08-15T22:39:53.154 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:39:53.214 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.4 2023-08-15T22:39:53.214 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:39:53.253 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:39:53.256 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:39:53.291 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:39:53.294 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-08-15T22:39:53.297 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-08-15T22:39:53.333 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-08-15T22:39:53.349 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:39:53.352 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:39:53.380 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:39:53.455 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-15T22:39:53.456 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:39:53.475 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-15T22:39:53.476 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:39:53.485 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-15T22:39:53.486 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:53.497 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-15T22:39:53.497 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:53.515 INFO:teuthology.orchestra.console.smithi194:Power off 2023-08-15T22:39:53.516 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:39:53.525 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-15T22:39:53.527 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-15T22:39:53.539 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-08-15T22:39:53.540 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:53.562 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-15T22:39:53.626 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-15T22:39:53.628 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-15T22:39:53.663 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-08-15T22:39:53.727 INFO:teuthology.orchestra.console.smithi102:Power on 2023-08-15T22:39:53.727 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:39:53.735 INFO:teuthology.orchestra.console.smithi116:Power on 2023-08-15T22:39:53.736 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:39:53.755 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-08-15T22:39:53.755 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:53.764 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-08-15T22:39:53.764 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:53.773 INFO:teuthology.orchestra.console.smithi194:Power on 2023-08-15T22:39:53.774 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:39:53.783 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-15T22:39:53.786 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-15T22:39:53.794 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-08-15T22:39:53.794 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:53.816 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-15T22:39:57.788 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:57.798 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:57.817 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:39:57.900 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-15T22:39:57.908 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-15T22:39:57.929 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-15T22:39:58.001 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-08-15T22:39:58.102 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-08-15T22:39:58.103 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:40:01.912 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:01.929 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:03.026 DEBUG:teuthology.orchestra.console.smithi116:check power output: 2023-08-15T22:40:03.039 DEBUG:teuthology.orchestra.console.smithi194:check power output: 2023-08-15T22:40:07.027 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:07.039 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:08.141 DEBUG:teuthology.orchestra.console.smithi116:check power output: 2023-08-15T22:40:08.150 DEBUG:teuthology.orchestra.console.smithi194:check power output: 2023-08-15T22:40:12.143 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:12.151 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:12.253 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-08-15T22:40:12.355 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-08-15T22:40:12.456 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-08-15T22:40:12.456 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:40:17.460 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:40:17.462 DEBUG:teuthology.orchestra.console.smithi194:check power output: 2023-08-15T22:40:22.465 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:23.575 DEBUG:teuthology.orchestra.console.smithi194:check power output: 2023-08-15T22:40:27.576 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:40:27.686 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-08-15T22:40:27.787 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-08-15T22:40:27.888 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-08-15T22:40:27.889 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:40:37.552 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:40:37.553 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:40:47.978 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:40:52.624 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:40:52.626 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:41:03.058 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:41:17.715 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:41:17.717 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:41:23.140 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:41:32.795 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:41:32.796 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:41:38.224 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:41:51.840 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:41:51.842 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:41:55.998 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:42:11.113 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:42:11.114 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:42:21.125 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:42:41.144 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-15T22:42:46.148 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-15T22:42:46.149 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-15T22:42:52.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:42:52.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:42:52.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:42:55.316 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-15T22:42:55.317 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-15T22:42:55.318 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-15T22:43:01.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:01.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:01.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:04.404 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-15T22:43:04.405 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-15T22:43:04.405 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-15T22:43:10.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:15.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:20.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:25.421 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-15T22:43:25.421 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-15T22:43:28.496 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-15T22:43:31.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:36.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:41.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:43:46.441 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-15T22:43:52.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:04.848 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-15T22:44:10.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:13.904 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-15T22:44:15.856 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-15T22:44:19.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:20.277 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:44:20.278 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:44:21.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:27.745 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:44:27.746 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:44:40.566 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-08-15T22:44:40.566 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-08-15T22:44:40.582 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-08-15T22:44:40.582 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-08-15T22:44:40.636 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-08-15T22:44:40.637 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-15T22:44:40.776 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-08-15T22:44:40.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-08-15T22:44:40.863 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-08-15T22:44:40.926 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-15T22:44:40.990 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-15T22:44:41.044 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:44:41.044 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:44:41.044 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-08-15T22:44:41.044 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-08-15T22:44:41.045 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.4" 2023-08-15T22:44:41.045 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:44:41.045 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:44:41.045 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-15T22:44:41.045 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:44:41.045 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:44:41.045 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:44:41.046 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:44:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-08-15T22:44:41.046 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:44:41.046 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:44:41.046 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:44:41.046 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:44:41.047 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-08-15T22:44:41.048 DEBUG:teuthology.parallel:result is None 2023-08-15T22:44:41.437 WARNING:teuthology.provision.fog.smithi194:timed out 2023-08-15T22:44:43.788 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-08-15T22:44:43.788 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-08-15T22:44:43.804 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-08-15T22:44:43.804 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-08-15T22:44:43.858 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-08-15T22:44:43.859 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-15T22:44:44.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-08-15T22:44:44.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-08-15T22:44:44.094 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-08-15T22:44:44.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-15T22:44:44.221 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-08-15T22:44:44.275 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:44:44.275 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:44:44.275 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-08-15T22:44:44.275 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-08-15T22:44:44.275 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4" 2023-08-15T22:44:44.276 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:44:44.276 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:44:44.276 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-08-15T22:44:44.276 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:44:44.276 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:44:44.276 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:44:44.276 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:44:44.277 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-08-15T22:44:44.277 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:44:44.277 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:44:44.277 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:44:44.277 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:44:44.277 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-08-15T22:44:44.278 DEBUG:teuthology.parallel:result is None 2023-08-15T22:44:47.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:52.770 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:44:52.771 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:44:53.055 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-08-15T22:44:53.056 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-08-15T22:44:53.071 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-08-15T22:44:53.071 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-08-15T22:44:53.126 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-08-15T22:44:53.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-08-15T22:44:53.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-08-15T22:44:53.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-08-15T22:44:53.331 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-08-15T22:44:53.394 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-08-15T22:44:53.457 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-08-15T22:44:53.510 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:44:53.510 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:44:53.510 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-08-15T22:44:53.510 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.4" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:44:53.511 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:44:53.512 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-15T22:44:53.512 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:44:53.512 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:44:53.512 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:44:53.512 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:44:53.512 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-08-15T22:44:53.513 DEBUG:teuthology.parallel:result is None 2023-08-15T22:44:55.954 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-08-15T22:44:55.955 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T22:44:55.975 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-08-15T22:44:55.976 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T22:44:55.991 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-08-15T22:44:55.991 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T22:44:56.010 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:44:56.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-15T22:44:56.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:56.079 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-08-15T22:44:56.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-15T22:44:56.154 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-08-15T22:44:56.207 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-08-15T22:44:56.208 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-08-15T22:44:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:44:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:44:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-08-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-08-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4" 2023-08-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-08-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:44:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:44:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:44:56.263 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-08-15T22:44:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:44:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:44:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:44:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:44:56.264 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-08-15T22:44:56.300 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:44:56.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-15T22:44:56.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:56.368 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-08-15T22:44:56.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-15T22:44:56.488 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-08-15T22:44:56.541 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-08-15T22:44:56.541 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-15T22:44:56.595 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:44:56.595 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:44:56.595 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-08-15T22:44:56.595 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-08-15T22:44:56.596 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.4" 2023-08-15T22:44:56.596 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:44:56.596 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:44:56.596 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-15T22:44:56.596 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:44:56.596 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:44:56.596 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:44:56.597 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:44:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-08-15T22:44:56.597 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:44:56.597 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:44:56.597 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:44:56.597 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:44:56.598 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-15T22:44:56.626 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:44:56.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-08-15T22:44:56.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:44:56.691 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-08-15T22:44:56.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-08-15T22:44:56.756 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-08-15T22:44:56.811 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-08-15T22:44:56.812 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-08-15T22:44:56.867 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:44:56.867 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:44:56.867 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-08-15T22:44:56.867 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-08-15T22:44:56.867 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.4" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:44:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-15T22:44:56.869 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:44:56.869 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:44:56.869 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:44:56.869 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:44:56.869 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-08-15T22:44:56.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:44:56.984 INFO:teuthology.dispatcher.supervisor:Running job 7368925 2023-08-15T22:44:56.985 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368925 --name yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}} -- /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368925/orig.config.yaml 2023-08-15T22:44:56.989 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368925 2023-08-15T22:44:56.990 INFO:teuthology.dispatcher.supervisor:Job PID: 13138 2023-08-15T22:44:56.990 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-15T22:46:57.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:49:02.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:51:07.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:53:12.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:55:17.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:57:20.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:59:26.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:01:31.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:03:36.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:05:37.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:07:43.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:09:48.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:11:53.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:11:56.636 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-15T23:11:56.774 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-15T23:11:56.775 INFO:teuthology.nuke:Checking targets against current locks 2023-08-15T23:11:56.813 DEBUG:teuthology.nuke:shortname: smithi102 2023-08-15T23:11:56.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T23:11:56.842 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:38:49.686227', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh1CftD+jby/QaFgilEYD7dU1XsJnlZD9P2CYhW9NVvAcInzJtJYTKKRAO16/5kW4df6m5Lc9Yxduj8sWbdV3Y='} 2023-08-15T23:11:56.843 DEBUG:teuthology.nuke:shortname: smithi116 2023-08-15T23:11:56.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T23:11:56.862 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:38:49.687483', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEcZMrPIy4k5DR1C5ja83tEpp+1fqcnX/QYQPBpsPYZJI98Ltl4p1O0w7YeySkteYOgyxOtWdzBvcEyN1rL6K0='} 2023-08-15T23:11:56.867 DEBUG:teuthology.nuke:shortname: smithi194 2023-08-15T23:11:56.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T23:11:56.893 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-15T23:11:56.894 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T23:11:56.910 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:38:49.684884', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3cndCte1BejOZqcyBI/hQQYtuSgHA0yEAycKlLMe6Z9DgFyvE2UGuziDtmS+XPcyUwlREnggEIQW4NSZ3V7bNyJy2JxYTaZQi6AIOHKLyxHt2CFgXY3oxNqm89EBeJWRiL7+ZNnFKqmlQhWfKFSCIZCKf3702VBX6kcrA3M0carfpUGIM+aPcKwyLrgz31Y7nJytqnTeWEABX6z3VsxITa+rc0lsrJATmMzE6uQpl3p6EfhMptrmBPmT+gOw+LJDOLLBfWlqJP6qDrsTMoRbo7h7Dp9NURDeByVd7XKk9zV9nLGY5AHJQ1CIxBy+LO2YqhlQEE29Ip1u5TKSPHXS3eIcUsJTgmDfOdjNJSGd2daNejmQafXo6SVX8Ee70wrgD4zS8oZDD/j3dqXu+KRLFQwF4rXwyN1Ct2wRFVYmfwjlD/9Y07k2q9oGonVYEKXgGFl/ru2FQo5/W4Brnsj8jb3tBQPgWUNlUwKsHXMoLBDRjqnzl97MS5+4EOybIH4c='} 2023-08-15T23:11:56.937 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-15T23:11:56.938 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T23:11:56.953 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-15T23:11:56.954 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:11:56.965 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-15T23:11:56.966 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:11:56.979 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-15T23:11:56.992 INFO:teuthology.orchestra.console.smithi194:Power off 2023-08-15T23:11:56.993 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T23:11:57.003 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-15T23:11:57.016 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-08-15T23:11:57.016 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:11:57.040 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-15T23:11:57.080 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-15T23:11:57.104 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-15T23:11:57.141 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-08-15T23:11:57.235 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-08-15T23:11:57.251 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-08-15T23:12:02.301 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com