2023-09-07T05:45:43.176 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-07T05:45:43.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T05:45:43.359 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f34d3dcb670>, signals=[15]) 2023-09-07T05:45:43.361 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-09-07T05:45:43.361 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-09-07T05:45:43.361 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-09-07T05:45:43.379 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-09-07T05:45:43.380 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-09-07T05:45:43.380 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-09-07T05:45:43.381 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-09-07T05:45:43.404 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-09-07T05:45:43.404 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-09-07T05:45:43.404 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-07T05:45:43.406 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-09-07T05:45:43.430 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-09-07T05:45:43.451 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-07T05:45:43.465 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-07T05:45:43.493 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-07T05:45:43.494 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 5} 2023-09-07T05:45:43.496 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-07T05:45:43.505 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-07T05:45:43.505 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 5} 2023-09-07T05:45:43.531 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-07T05:45:43.531 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 5} 2023-09-07T05:45:43.553 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6 2023-09-07T05:45:43.554 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:45:43.557 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6 2023-09-07T05:45:43.557 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:45:43.569 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6 2023-09-07T05:45:43.569 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:45:43.613 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-09-07T05:45:43.617 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-09-07T05:45:43.623 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-09-07T05:45:43.651 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-09-07T05:45:43.654 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-09-07T05:45:43.657 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-09-07T05:45:43.704 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:45:43.707 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:45:43.719 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:45:43.817 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-07T05:45:43.818 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T05:45:43.829 INFO:teuthology.orchestra.console.smithi022:Power off 2023-09-07T05:45:43.830 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T05:45:43.839 INFO:teuthology.orchestra.console.smithi093:Power off 2023-09-07T05:45:43.839 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T05:45:43.848 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-07T05:45:43.848 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:43.855 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-09-07T05:45:43.856 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:43.864 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-09-07T05:45:43.864 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:43.875 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-07T05:45:43.878 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-09-07T05:45:43.887 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-07T05:45:43.988 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-09-07T05:45:44.089 INFO:teuthology.orchestra.console.smithi093:Power on 2023-09-07T05:45:44.090 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-07T05:45:44.110 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-09-07T05:45:44.111 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:44.130 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-07T05:45:47.878 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:47.884 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:47.987 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-07T05:45:47.993 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-09-07T05:45:48.131 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:48.240 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-07T05:45:51.989 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:51.996 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:52.099 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-07T05:45:52.105 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-07T05:45:52.200 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-07T05:45:52.206 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-09-07T05:45:52.241 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:52.302 INFO:teuthology.orchestra.console.smithi103:Power on 2023-09-07T05:45:52.302 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-07T05:45:52.309 INFO:teuthology.orchestra.console.smithi022:Power on 2023-09-07T05:45:52.309 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-07T05:45:52.321 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-09-07T05:45:52.322 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:52.330 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-09-07T05:45:52.330 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:52.343 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-07T05:45:52.349 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-09-07T05:45:52.350 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-07T05:45:52.450 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-09-07T05:45:52.550 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-09-07T05:45:52.551 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:45:56.346 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:56.353 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:45:56.455 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-07T05:45:56.461 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-07T05:46:00.461 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:00.467 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T05:46:00.569 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-07T05:46:00.576 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-09-07T05:46:00.671 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-09-07T05:46:00.676 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-09-07T05:46:00.773 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-09-07T05:46:00.773 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:46:00.777 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-09-07T05:46:00.777 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:46:07.714 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:46:15.996 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:46:15.998 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:46:22.918 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:46:31.224 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:46:31.225 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:46:38.156 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:46:46.446 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:46:46.462 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:46:53.381 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:47:01.690 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:47:01.694 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:47:08.639 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:47:16.962 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:47:16.986 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:47:23.910 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:47:32.226 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:47:32.234 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:47:39.197 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:47:47.524 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:47:47.535 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:47:54.502 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:48:02.914 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:48:02.917 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:48:09.847 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:48:18.433 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:48:18.435 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:48:25.311 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:48:33.872 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:48:33.882 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-07T05:48:34.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:48:34.516 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: Authentication failed. 2023-09-07T05:48:34.518 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-07T05:48:34.519 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-07T05:48:34.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-07T05:48:40.682 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-07T05:48:40.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:48:49.211 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:48:59.418 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-07T05:49:04.551 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:49:05.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:49:08.474 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-07T05:49:14.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:49:17.530 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-07T05:49:20.050 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:49:23.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:49:26.586 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-07T05:49:32.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:49:35.430 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:49:35.642 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-07T05:49:41.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:49:50.841 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:50:06.324 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:50:21.654 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:50:34.394 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-07T05:50:34.396 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi022 2023-09-07T05:50:36.998 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:50:41.650 WARNING:teuthology.provision.fog.smithi093:timed out 2023-09-07T05:50:43.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-09-07T05:50:43.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:50:43.630 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-09-07T05:50:43.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-09-07T05:50:43.921 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-07T05:50:43.922 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-07T05:50:43.942 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-09-07T05:50:43.943 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-09-07T05:50:44.003 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-09-07T05:50:44.003 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-09-07T05:50:44.064 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-07T05:50:44.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-09-07T05:50:44.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-09-07T05:50:44.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-09-07T05:50:44.299 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-09-07T05:50:44.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-09-07T05:50:44.439 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-09-07T05:50:44.499 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-09-07T05:50:44.499 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-09-07T05:50:44.499 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-09-07T05:50:44.500 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-09-07T05:50:44.500 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-09-07T05:50:44.500 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-09-07T05:50:44.501 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-07T05:50:44.501 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-09-07T05:50:44.501 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-07T05:50:44.501 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-09-07T05:50:44.502 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-07T05:50:44.502 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-07T05:50:44.502 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-09-07T05:50:44.503 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-07T05:50:44.503 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-07T05:50:44.503 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-07T05:50:44.504 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-07T05:50:44.504 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-09-07T05:50:44.507 DEBUG:teuthology.parallel:result is None 2023-09-07T05:50:47.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:50:47.992 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-07T05:50:47.992 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-07T05:50:48.252 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-09-07T05:50:48.253 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-09-07T05:50:48.273 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2023-09-07T05:50:48.273 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2023-09-07T05:50:48.333 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-09-07T05:50:48.333 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-09-07T05:50:48.450 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2023-09-07T05:50:48.483 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-09-07T05:50:48.555 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2023-09-07T05:50:48.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-09-07T05:50:48.702 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-09-07T05:50:48.762 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-09-07T05:50:48.762 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-09-07T05:50:48.763 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-09-07T05:50:48.763 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-09-07T05:50:48.763 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-09-07T05:50:48.763 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-09-07T05:50:48.764 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-07T05:50:48.764 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-09-07T05:50:48.764 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-07T05:50:48.764 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-09-07T05:50:48.765 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-07T05:50:48.765 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-07T05:50:48.765 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-09-07T05:50:48.765 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-07T05:50:48.766 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-07T05:50:48.766 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-07T05:50:48.766 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-07T05:50:48.767 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-09-07T05:50:48.767 DEBUG:teuthology.parallel:result is None 2023-09-07T05:50:52.303 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:51:07.814 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:51:23.122 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:51:38.374 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:51:53.602 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:52:08.819 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:52:24.023 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:52:39.200 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:52:54.380 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:53:09.574 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:53:24.740 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:53:39.890 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:53:55.030 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:54:10.178 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-07T05:54:10.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:13.370 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:54:19.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:22.426 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:54:28.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:31.514 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:54:37.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:40.570 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:54:46.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:49.626 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:54:55.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:54:58.718 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:55:04.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:07.802 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:55:13.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:16.858 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:55:22.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:41.338 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:55:47.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:50.394 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-07T05:55:56.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:56.935 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-07T05:55:56.935 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-07T05:55:57.298 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-09-07T05:55:57.299 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-09-07T05:55:57.315 INFO:teuthology.orchestra.run.smithi103.stdout:smithi022 2023-09-07T05:55:57.316 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi022 /etc/hosts 2023-09-07T05:55:57.371 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-07T05:55:57.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-07T05:55:57.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi022/smithi103/g' /etc/hosts 2023-09-07T05:55:57.595 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.22/172.21.15.103/g' /etc/hosts 2023-09-07T05:55:57.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi022/smithi103/g' /etc/hostname 2023-09-07T05:55:57.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-07T05:55:57.795 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-07T05:55:57.851 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-09-07T05:55:57.852 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-09-07T05:55:57.852 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-09-07T05:55:57.852 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-09-07T05:55:57.852 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-09-07T05:55:57.852 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-09-07T05:55:57.853 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-07T05:55:57.853 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-07T05:55:57.853 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-07T05:55:57.853 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-09-07T05:55:57.853 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-07T05:55:57.854 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-07T05:55:57.854 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-09-07T05:55:57.854 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-07T05:55:57.854 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-07T05:55:57.854 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-07T05:55:57.855 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-07T05:55:57.855 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-09-07T05:55:57.856 DEBUG:teuthology.parallel:result is None 2023-09-07T05:55:58.045 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-09-07T05:55:58.045 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-07T05:55:58.072 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-09-07T05:55:58.072 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-07T05:55:58.088 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-09-07T05:55:58.088 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-07T05:55:58.114 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-09-07T05:55:58.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-09-07T05:55:58.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:58.189 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-09-07T05:55:58.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-09-07T05:55:58.330 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-09-07T05:55:58.387 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-09-07T05:55:58.388 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-09-07T05:55:58.446 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-09-07T05:55:58.446 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-09-07T05:55:58.446 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-09-07T05:55:58.446 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-09-07T05:55:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-09-07T05:55:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-09-07T05:55:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-07T05:55:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-09-07T05:55:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-07T05:55:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-09-07T05:55:58.448 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-07T05:55:58.448 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-07T05:55:58.448 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-09-07T05:55:58.448 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-07T05:55:58.448 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-07T05:55:58.449 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-07T05:55:58.449 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-07T05:55:58.449 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-09-07T05:55:58.472 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-09-07T05:55:58.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-09-07T05:55:58.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:58.546 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-09-07T05:55:58.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-09-07T05:55:58.684 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-09-07T05:55:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-09-07T05:55:58.742 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-09-07T05:55:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-09-07T05:55:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-09-07T05:55:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-09-07T05:55:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-09-07T05:55:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-09-07T05:55:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-09-07T05:55:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-07T05:55:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-09-07T05:55:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-07T05:55:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-09-07T05:55:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-07T05:55:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-07T05:55:58.803 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-09-07T05:55:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-07T05:55:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-07T05:55:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-07T05:55:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-07T05:55:58.804 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-09-07T05:55:58.838 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-09-07T05:55:58.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-07T05:55:58.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-07T05:55:58.906 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-09-07T05:55:58.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-07T05:55:58.971 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-09-07T05:55:59.026 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-09-07T05:55:59.027 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-07T05:55:59.083 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-09-07T05:55:59.083 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-09-07T05:55:59.084 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-09-07T05:55:59.084 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-09-07T05:55:59.084 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-09-07T05:55:59.084 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-09-07T05:55:59.085 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-07T05:55:59.085 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-07T05:55:59.085 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-07T05:55:59.085 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-09-07T05:55:59.085 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-07T05:55:59.086 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-07T05:55:59.086 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-09-07T05:55:59.086 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-07T05:55:59.086 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-07T05:55:59.087 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-07T05:55:59.087 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-07T05:55:59.087 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-07T05:55:59.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T05:55:59.237 INFO:teuthology.dispatcher.supervisor:Running job 7390511 2023-09-07T05:55:59.238 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390511 --name vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390511/orig.config.yaml 2023-09-07T05:55:59.243 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390511 2023-09-07T05:55:59.243 INFO:teuthology.dispatcher.supervisor:Job PID: 1064577 2023-09-07T05:55:59.244 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-07T05:57:59.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T05:59:59.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:01:59.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:03:59.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:06:00.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:08:00.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:10:00.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:12:00.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:14:00.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:16:00.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:18:00.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:20:01.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:22:01.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:24:01.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:26:01.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:28:01.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:30:01.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:32:02.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:34:02.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:36:02.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:38:02.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:40:02.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:42:02.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:44:03.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:46:03.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:48:03.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:50:03.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:52:03.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:54:03.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-07T06:54:04.060 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-07T06:54:04.266 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-07T06:54:04.267 INFO:teuthology.nuke:Checking targets against current locks 2023-09-07T06:54:04.320 DEBUG:teuthology.nuke:shortname: smithi022 2023-09-07T06:54:04.321 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-07T06:54:04.346 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390511', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-07 05:45:42.367441', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-07T06:54:04.349 DEBUG:teuthology.nuke:shortname: smithi093 2023-09-07T06:54:04.350 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-07T06:54:04.361 DEBUG:teuthology.nuke:shortname: smithi103 2023-09-07T06:54:04.361 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-07T06:54:04.373 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390511', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-07 05:45:42.368406', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-07T06:54:04.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-07_05:44:31-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7390511', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-07 05:45:42.366244', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-07T06:54:04.404 INFO:teuthology.orchestra.console.smithi022:Power off 2023-09-07T06:54:04.405 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T06:54:04.428 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-09-07T06:54:04.429 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T06:54:04.446 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-07T06:54:04.446 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T06:54:04.458 INFO:teuthology.orchestra.console.smithi093:Power off 2023-09-07T06:54:04.460 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-07T06:54:04.468 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-07T06:54:04.468 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T06:54:04.477 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-07T06:54:04.482 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-09-07T06:54:04.483 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-07T06:54:04.492 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-07T06:54:04.504 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-07T06:54:04.578 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-09-07T06:54:04.593 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-07T06:54:04.605 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-09-07T06:54:04.738 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-09-07T06:54:04.752 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-09-07T06:54:04.760 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com