2023-08-23T17:21:01.425 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T17:21:01.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:21:01.615 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdf22d3d310>, signals=[15]) 2023-08-23T17:21:01.617 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-08-23T17:21:01.617 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T17:21:01.618 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-08-23T17:21:01.637 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-08-23T17:21:01.637 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T17:21:01.638 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-08-23T17:21:01.640 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-08-23T17:21:01.669 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-08-23T17:21:01.670 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T17:21:01.670 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-08-23T17:21:01.671 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-08-23T17:21:01.694 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-08-23T17:21:01.718 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T17:21:01.742 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T17:21:01.755 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T17:21:01.762 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T17:21:01.763 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 5} 2023-08-23T17:21:01.779 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T17:21:01.779 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 5} 2023-08-23T17:21:01.791 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T17:21:01.792 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 5} 2023-08-23T17:21:01.808 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6 2023-08-23T17:21:01.808 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:21:01.826 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of rhel 8.6 2023-08-23T17:21:01.826 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:21:01.840 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of rhel 8.6 2023-08-23T17:21:01.840 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:21:01.850 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T17:21:01.870 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T17:21:01.879 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T17:21:01.885 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-08-23T17:21:01.901 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-08-23T17:21:01.914 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-08-23T17:21:01.948 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:21:01.959 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:21:01.965 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:21:02.031 INFO:teuthology.orchestra.console.smithi149:Power off 2023-08-23T17:21:02.032 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T17:21:02.048 INFO:teuthology.orchestra.console.smithi069:Power off 2023-08-23T17:21:02.049 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T17:21:02.063 INFO:teuthology.orchestra.console.smithi032:Power off 2023-08-23T17:21:02.063 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T17:21:02.071 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-08-23T17:21:02.072 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:02.080 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-08-23T17:21:02.081 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:02.090 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-08-23T17:21:02.090 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:02.101 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-23T17:21:02.102 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-08-23T17:21:02.112 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-08-23T17:21:06.104 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:06.112 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:06.120 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:06.215 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-23T17:21:06.223 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-08-23T17:21:06.231 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-08-23T17:21:10.216 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:10.225 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:10.233 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:10.327 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-23T17:21:10.335 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-08-23T17:21:10.344 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-08-23T17:21:10.429 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-08-23T17:21:10.445 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-08-23T17:21:10.531 INFO:teuthology.orchestra.console.smithi069:Power on 2023-08-23T17:21:10.531 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T17:21:10.546 INFO:teuthology.orchestra.console.smithi032:Power on 2023-08-23T17:21:10.547 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T17:21:10.558 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-08-23T17:21:10.558 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:10.570 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2023-08-23T17:21:10.571 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:10.580 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-23T17:21:10.591 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-08-23T17:21:14.336 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:14.447 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-08-23T17:21:14.549 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-08-23T17:21:14.581 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:14.592 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:14.651 INFO:teuthology.orchestra.console.smithi149:Power on 2023-08-23T17:21:14.652 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T17:21:14.677 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2023-08-23T17:21:14.678 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:14.693 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-23T17:21:14.699 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-08-23T17:21:14.702 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-08-23T17:21:18.696 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:18.704 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:18.715 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:18.816 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-08-23T17:21:18.826 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-08-23T17:21:18.858 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-23T17:21:18.927 INFO:teuthology.orchestra.console.smithi032:Power on completed 2023-08-23T17:21:18.960 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-08-23T17:21:19.029 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-08-23T17:21:19.029 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:21:19.061 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-08-23T17:21:19.061 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:21:22.820 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T17:21:22.931 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-08-23T17:21:23.032 INFO:teuthology.orchestra.console.smithi149:Power on completed 2023-08-23T17:21:23.133 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-08-23T17:21:23.133 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:21:34.097 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:21:34.117 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:21:38.196 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:21:49.159 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:21:49.172 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:21:53.260 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:22:04.220 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:22:04.225 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:22:08.320 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:22:19.292 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:22:19.293 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:22:23.384 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:22:34.357 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:22:34.358 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:22:38.448 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:22:49.432 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:22:49.433 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:22:53.528 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:23:04.516 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:23:04.517 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:23:08.596 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:23:19.584 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:23:19.585 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:23:23.672 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:23:34.656 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-08-23T17:23:34.658 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:23:34.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:23:35.031 ERROR:teuthology.orchestra.connection:Error authenticating with smithi032.front.sepia.ceph.com: Authentication failed. 2023-08-23T17:23:35.034 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T17:23:35.035 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T17:23:35.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-23T17:23:38.739 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:23:49.740 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:23:53.810 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-23T17:23:53.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:23:56.944 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-23T17:24:02.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:04.792 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-23T17:24:04.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:06.000 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-23T17:24:07.920 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-23T17:24:12.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:13.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:15.056 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-23T17:24:16.976 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-23T17:24:21.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:22.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:24.116 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-23T17:24:26.036 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-23T17:24:30.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:32.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:33.168 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-23T17:24:35.088 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-23T17:24:39.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:41.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:42.224 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-23T17:24:44.144 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-23T17:24:48.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:50.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:51.284 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-23T17:24:53.204 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-23T17:24:57.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:24:59.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:25:57.288 WARNING:teuthology.provision.fog.smithi149:timed out 2023-08-23T17:25:59.208 WARNING:teuthology.provision.fog.smithi069:timed out 2023-08-23T17:26:03.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:26:03.652 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T17:26:03.652 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T17:26:03.974 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-08-23T17:26:03.975 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-08-23T17:26:03.993 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-08-23T17:26:03.994 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-08-23T17:26:04.052 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-08-23T17:26:04.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-08-23T17:26:04.164 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-08-23T17:26:04.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-08-23T17:26:04.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-08-23T17:26:04.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-08-23T17:26:04.392 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-08-23T17:26:04.448 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T17:26:04.448 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T17:26:04.449 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-08-23T17:26:04.449 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-08-23T17:26:04.449 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-08-23T17:26:04.449 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-08-23T17:26:04.449 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T17:26:04.449 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-08-23T17:26:04.449 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T17:26:04.450 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T17:26:04.450 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T17:26:04.450 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T17:26:04.450 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-23T17:26:04.450 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T17:26:04.450 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T17:26:04.450 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T17:26:04.451 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T17:26:04.451 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-08-23T17:26:04.453 DEBUG:teuthology.parallel:result is None 2023-08-23T17:26:05.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:26:05.523 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T17:26:05.523 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T17:26:05.791 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-08-23T17:26:05.792 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-08-23T17:26:05.808 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 2023-08-23T17:26:05.809 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069 /etc/hosts 2023-08-23T17:26:05.865 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-08-23T17:26:05.865 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-08-23T17:26:05.979 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069/smithi069/g' /etc/hosts 2023-08-23T17:26:06.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-08-23T17:26:06.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069/smithi069/g' /etc/hostname 2023-08-23T17:26:06.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-08-23T17:26:06.204 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-08-23T17:26:06.260 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T17:26:06.261 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T17:26:06.261 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-08-23T17:26:06.261 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-08-23T17:26:06.261 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6" 2023-08-23T17:26:06.261 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-08-23T17:26:06.261 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T17:26:06.261 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T17:26:06.262 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T17:26:06.263 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T17:26:06.263 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-08-23T17:26:06.263 DEBUG:teuthology.parallel:result is None 2023-08-23T17:26:09.264 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-23T17:26:09.265 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi032 2023-08-23T17:26:18.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-08-23T17:26:18.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:26:18.501 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-08-23T17:26:18.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-08-23T17:26:18.816 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T17:26:18.816 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T17:26:18.836 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-08-23T17:26:18.836 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-08-23T17:26:18.894 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-08-23T17:26:18.895 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-08-23T17:26:18.954 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-08-23T17:26:18.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-08-23T17:26:19.088 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-08-23T17:26:19.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-08-23T17:26:19.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-08-23T17:26:19.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-08-23T17:26:19.328 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-08-23T17:26:19.385 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T17:26:19.385 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T17:26:19.385 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T17:26:19.386 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T17:26:19.387 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T17:26:19.387 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-08-23T17:26:19.387 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T17:26:19.387 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T17:26:19.387 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T17:26:19.387 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T17:26:19.388 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-08-23T17:26:19.388 DEBUG:teuthology.parallel:result is None 2023-08-23T17:26:19.563 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-08-23T17:26:19.564 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-08-23T17:26:19.564 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-08-23T17:26:19.565 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T17:26:19.581 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-08-23T17:26:19.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-08-23T17:26:19.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:26:19.647 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-08-23T17:26:19.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-08-23T17:26:19.713 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-08-23T17:26:19.770 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-08-23T17:26:19.771 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-08-23T17:26:19.828 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T17:26:19.828 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T17:26:19.828 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-08-23T17:26:19.828 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-08-23T17:26:19.828 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T17:26:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-08-23T17:26:19.830 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T17:26:19.830 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T17:26:19.830 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T17:26:19.830 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T17:26:19.831 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-08-23T17:26:19.855 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-08-23T17:26:19.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-23T17:26:19.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:26:19.921 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-08-23T17:26:20.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-23T17:26:20.050 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-08-23T17:26:20.107 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-08-23T17:26:20.107 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-08-23T17:26:20.164 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T17:26:20.165 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T17:26:20.165 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-08-23T17:26:20.165 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-08-23T17:26:20.165 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6" 2023-08-23T17:26:20.165 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-08-23T17:26:20.165 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T17:26:20.166 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T17:26:20.167 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T17:26:20.167 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T17:26:20.167 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-08-23T17:26:20.189 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-08-23T17:26:20.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-23T17:26:20.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T17:26:20.256 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-08-23T17:26:20.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-23T17:26:20.386 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-08-23T17:26:20.442 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-08-23T17:26:20.443 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-08-23T17:26:20.500 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T17:26:20.500 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T17:26:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T17:26:20.502 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T17:26:20.502 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T17:26:20.502 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-23T17:26:20.502 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T17:26:20.502 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T17:26:20.502 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T17:26:20.502 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T17:26:20.503 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-08-23T17:26:20.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:26:20.636 INFO:teuthology.dispatcher.supervisor:Running job 7376049 2023-08-23T17:26:20.636 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376049 --name vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376049/orig.config.yaml 2023-08-23T17:26:20.640 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376049 2023-08-23T17:26:20.640 INFO:teuthology.dispatcher.supervisor:Job PID: 3856 2023-08-23T17:26:20.641 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-23T17:28:20.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:30:20.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:32:21.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:34:21.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:36:21.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:38:21.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:40:21.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:42:21.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:44:22.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:46:22.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:48:22.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:50:22.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:52:22.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:54:23.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:56:23.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T17:58:23.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:00:23.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:02:23.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:04:23.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:06:24.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:08:24.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:10:24.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:12:24.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:14:24.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:16:24.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:18:25.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T18:18:25.262 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-23T18:18:25.486 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-23T18:18:25.487 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T18:18:25.532 DEBUG:teuthology.nuke:shortname: smithi032 2023-08-23T18:18:25.533 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T18:18:25.558 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376049', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 17:21:00.294551', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-23T18:18:25.561 DEBUG:teuthology.nuke:shortname: smithi069 2023-08-23T18:18:25.562 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T18:18:25.582 DEBUG:teuthology.nuke:shortname: smithi149 2023-08-23T18:18:25.583 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T18:18:25.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376049', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 17:21:00.292061', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-23T18:18:25.610 INFO:teuthology.orchestra.console.smithi032:Power off 2023-08-23T18:18:25.611 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T18:18:25.622 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376049', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 17:21:00.293409', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-23T18:18:25.632 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-08-23T18:18:25.632 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T18:18:25.653 INFO:teuthology.orchestra.console.smithi069:Power off 2023-08-23T18:18:25.654 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T18:18:25.669 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-08-23T18:18:25.677 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-08-23T18:18:25.677 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T18:18:25.699 INFO:teuthology.orchestra.console.smithi149:Power off 2023-08-23T18:18:25.700 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T18:18:25.711 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-23T18:18:25.722 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-08-23T18:18:25.723 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T18:18:25.750 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-08-23T18:18:25.770 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-08-23T18:18:25.813 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-08-23T18:18:25.851 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-08-23T18:18:25.918 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-08-23T18:18:25.960 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-08-23T18:18:25.993 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com