2023-07-20T02:47:50.643 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T02:47:50.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:47:50.645 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:47:50.857 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f73cdc1d8b0>, signals=[15]) 2023-07-20T02:47:50.859 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-07-20T02:47:50.859 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:47:50.859 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-07-20T02:47:50.886 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-07-20T02:47:50.886 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:47:50.886 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-07-20T02:47:50.887 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-07-20T02:47:50.910 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-07-20T02:47:50.911 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:47:50.911 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-07-20T02:47:50.912 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-07-20T02:47:50.937 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-07-20T02:47:50.964 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:47:50.980 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:47:51.005 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:47:51.005 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 5} 2023-07-20T02:47:51.008 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:47:51.026 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:47:51.027 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 5} 2023-07-20T02:47:51.041 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:47:51.041 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 5} 2023-07-20T02:47:51.050 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6 2023-07-20T02:47:51.050 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:47:51.064 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6 2023-07-20T02:47:51.065 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:47:51.086 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.6 2023-07-20T02:47:51.086 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:47:51.091 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:47:51.102 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:47:51.120 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-07-20T02:47:51.129 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:47:51.137 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-07-20T02:47:51.159 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-07-20T02:47:51.198 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:47:51.205 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:47:51.213 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:47:51.292 INFO:teuthology.orchestra.console:Power off smithi057 2023-07-20T02:47:51.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:47:51.314 INFO:teuthology.orchestra.console:Power off smithi179 2023-07-20T02:47:51.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:47:51.329 INFO:teuthology.orchestra.console:Power off smithi195 2023-07-20T02:47:51.330 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:47:51.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:51.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:51.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:55.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:55.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:55.394 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:59.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:59.498 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:59.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:59.701 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2023-07-20T02:47:59.710 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-07-20T02:47:59.720 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-07-20T02:47:59.802 INFO:teuthology.orchestra.console:Power on smithi179 2023-07-20T02:47:59.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:47:59.812 INFO:teuthology.orchestra.console:Power on smithi057 2023-07-20T02:47:59.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:47:59.822 INFO:teuthology.orchestra.console:Power on smithi195 2023-07-20T02:47:59.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:47:59.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:59.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:47:59.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:48:03.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:48:03.885 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:48:03.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:48:07.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:48:08.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:48:08.011 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:48:08.202 INFO:teuthology.orchestra.console:Power on for smithi179 completed 2023-07-20T02:48:08.218 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2023-07-20T02:48:08.304 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-07-20T02:48:08.304 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:48:08.319 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-07-20T02:48:08.320 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:48:08.345 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2023-07-20T02:48:08.446 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-07-20T02:48:08.447 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:48:23.374 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:48:23.375 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:48:23.497 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:48:38.444 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:48:38.445 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:48:38.556 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:48:53.532 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:48:53.533 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:48:53.615 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:49:08.616 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:49:08.617 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:49:08.676 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:49:23.705 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:49:23.707 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:49:23.736 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:49:38.800 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:49:38.801 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:49:38.806 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:49:53.896 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:49:53.898 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:49:53.900 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:50:09.000 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:50:09.001 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:50:09.002 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:50:24.107 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:50:24.108 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:50:24.109 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:50:39.204 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-20T02:50:39.206 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:50:39.213 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:50:39.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:50:39.609 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: Authentication failed. 2023-07-20T02:50:39.611 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:50:39.611 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:50:39.612 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-20T02:50:54.316 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-20T02:50:54.319 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-20T02:50:54.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:50:54.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:50:57.491 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-20T02:50:57.491 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-20T02:51:03.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:03.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:06.548 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-20T02:51:06.549 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-20T02:51:12.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:12.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:15.600 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-20T02:51:15.601 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-20T02:51:21.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:21.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:24.660 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-20T02:51:24.661 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-20T02:51:30.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:30.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:33.716 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-20T02:51:33.717 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-20T02:51:39.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:39.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:42.772 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-20T02:51:42.773 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-20T02:51:48.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:48.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:51:51.828 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-20T02:51:57.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:52:48.776 WARNING:teuthology.provision.fog.smithi057:timed out 2023-07-20T02:52:54.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:52:55.009 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:52:55.010 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:52:55.331 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-07-20T02:52:55.331 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-07-20T02:52:55.351 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-07-20T02:52:55.352 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-07-20T02:52:55.410 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-07-20T02:52:55.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-07-20T02:52:55.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-07-20T02:52:55.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-07-20T02:52:55.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-07-20T02:52:55.703 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-07-20T02:52:55.772 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-07-20T02:52:55.829 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:52:55.830 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:52:55.830 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-07-20T02:52:55.830 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-07-20T02:52:55.830 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-07-20T02:52:55.830 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:52:55.830 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:52:55.831 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:52:55.832 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:52:55.832 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:52:55.832 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-07-20T02:52:55.834 DEBUG:teuthology.parallel:result is None 2023-07-20T02:52:57.832 WARNING:teuthology.provision.fog.smithi179:timed out 2023-07-20T02:53:03.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:53:04.157 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:53:04.157 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:53:04.480 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-07-20T02:53:04.480 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-07-20T02:53:04.498 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179 2023-07-20T02:53:04.498 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179 /etc/hosts 2023-07-20T02:53:04.556 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-07-20T02:53:04.557 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-07-20T02:53:04.678 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hosts 2023-07-20T02:53:04.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-07-20T02:53:04.781 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hostname 2023-07-20T02:53:04.851 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-07-20T02:53:04.921 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-07-20T02:53:04.982 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:53:04.983 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:53:04.983 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-07-20T02:53:04.983 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-07-20T02:53:04.983 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-07-20T02:53:04.983 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:53:04.983 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:53:04.983 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-07-20T02:53:04.984 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:53:04.984 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:53:04.984 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:53:04.984 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:53:04.984 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-20T02:53:04.984 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:53:04.984 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:53:04.985 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:53:04.985 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:53:04.985 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-07-20T02:53:04.986 DEBUG:teuthology.parallel:result is None 2023-07-20T02:53:13.716 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-20T02:53:13.717 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi195 2023-07-20T02:53:22.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-20T02:53:22.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:53:23.053 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-07-20T02:53:23.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-20T02:53:23.327 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:53:23.328 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:53:23.345 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-07-20T02:53:23.346 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-07-20T02:53:23.403 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195 2023-07-20T02:53:23.404 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195 /etc/hosts 2023-07-20T02:53:23.462 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-07-20T02:53:23.462 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-07-20T02:53:23.583 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195/smithi195/g' /etc/hosts 2023-07-20T02:53:23.612 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-07-20T02:53:23.680 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195/smithi195/g' /etc/hostname 2023-07-20T02:53:23.746 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-07-20T02:53:23.812 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-07-20T02:53:23.870 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:53:23.870 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:53:23.871 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-07-20T02:53:23.871 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-07-20T02:53:23.871 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-07-20T02:53:23.872 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:53:23.872 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:53:23.872 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-07-20T02:53:23.872 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:53:23.873 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:53:23.873 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:53:23.873 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:53:23.874 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-20T02:53:23.874 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:53:23.874 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:53:23.874 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:53:23.875 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:53:23.875 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-07-20T02:53:23.876 DEBUG:teuthology.parallel:result is None 2023-07-20T02:53:24.097 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-07-20T02:53:24.098 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:53:24.125 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-07-20T02:53:24.126 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:53:24.150 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-07-20T02:53:24.151 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:53:24.178 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:53:24.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-07-20T02:53:24.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:53:24.250 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-07-20T02:53:24.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-07-20T02:53:24.383 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-07-20T02:53:24.441 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-07-20T02:53:24.441 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-07-20T02:53:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:53:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:53:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-07-20T02:53:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:53:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:53:24.502 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-07-20T02:53:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:53:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:53:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:53:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:53:24.503 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-07-20T02:53:24.526 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:53:24.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-20T02:53:24.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:53:24.594 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-07-20T02:53:24.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-20T02:53:24.686 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-07-20T02:53:24.743 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-07-20T02:53:24.743 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-07-20T02:53:24.800 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:53:24.800 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:53:24.800 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-07-20T02:53:24.801 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-07-20T02:53:24.801 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-07-20T02:53:24.801 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-20T02:53:24.802 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:53:24.803 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:53:24.803 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:53:24.803 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:53:24.803 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-07-20T02:53:24.825 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:53:24.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-20T02:53:24.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:53:24.893 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-07-20T02:53:24.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-20T02:53:24.968 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-07-20T02:53:25.026 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-07-20T02:53:25.027 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-07-20T02:53:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:53:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:53:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-07-20T02:53:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-07-20T02:53:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-07-20T02:53:25.086 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:53:25.086 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:53:25.086 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-07-20T02:53:25.086 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:53:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:53:25.088 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-07-20T02:53:25.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:53:25.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:53:25.217 INFO:teuthology.dispatcher.supervisor:Running job 7344324 2023-07-20T02:53:25.218 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344324 --name pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}} -- /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344324/orig.config.yaml 2023-07-20T02:53:25.221 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344324 2023-07-20T02:53:25.222 INFO:teuthology.dispatcher.supervisor:Job PID: 2382 2023-07-20T02:53:25.222 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T02:55:25.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:55:25.321 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:57:25.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:57:25.505 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:59:25.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:59:25.676 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:01:25.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:01:25.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:03:26.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:03:26.025 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:05:26.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:05:26.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:07:26.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:07:26.368 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:09:26.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:09:26.537 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:11:26.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:11:26.710 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:13:26.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:13:26.886 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:15:27.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:15:27.060 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:17:27.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:17:27.231 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:19:27.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:19:27.406 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:21:27.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:21:27.569 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:23:27.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:23:27.745 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:25:27.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:25:27.905 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:27:28.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:27:28.081 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:29:28.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:29:28.244 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:31:28.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:31:28.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:31:28.475 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T03:31:28.624 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T03:31:28.624 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T03:31:28.684 DEBUG:teuthology.nuke:shortname: smithi057 2023-07-20T03:31:28.685 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T03:31:28.709 DEBUG:teuthology.nuke:shortname: smithi179 2023-07-20T03:31:28.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T03:31:28.711 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344324', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:47:49.776711', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T03:31:28.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344324', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:47:49.773704', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-20T03:31:28.735 DEBUG:teuthology.nuke:shortname: smithi195 2023-07-20T03:31:28.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T03:31:28.761 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344324', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:47:49.775300', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-20T03:31:28.769 INFO:teuthology.orchestra.console:Power off smithi057 2023-07-20T03:31:28.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T03:31:28.783 INFO:teuthology.orchestra.console:Power off smithi179 2023-07-20T03:31:28.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T03:31:28.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T03:31:28.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T03:31:28.836 INFO:teuthology.orchestra.console:Power off smithi195 2023-07-20T03:31:28.837 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T03:31:28.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T03:31:28.915 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-07-20T03:31:28.925 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2023-07-20T03:31:28.976 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-07-20T03:31:29.083 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-07-20T03:31:29.092 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2023-07-20T03:31:29.133 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com