2023-08-08T11:16:56.026 INFO:root:teuthology version: 0.0.1.dev176+g250cac1 2023-08-08T11:16:56.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:16:56.208 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6cba8d4280>, signals=[15]) 2023-08-08T11:16:56.209 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-08-08T11:16:56.210 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T11:16:56.210 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-08-08T11:16:56.233 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-08-08T11:16:56.233 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T11:16:56.234 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-08-08T11:16:56.235 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-08-08T11:16:56.258 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"} 2023-08-08T11:16:56.316 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T11:16:56.326 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T11:16:56.361 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T11:16:56.361 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 3} 2023-08-08T11:16:56.377 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T11:16:56.377 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 3} 2023-08-08T11:16:56.413 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream 2023-08-08T11:16:56.414 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:16:56.419 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 8.stream 2023-08-08T11:16:56.419 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:16:56.489 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T11:16:56.492 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T11:16:56.540 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-08-08T11:16:56.543 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1} 2023-08-08T11:16:56.601 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:16:56.697 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:16:56.754 INFO:teuthology.orchestra.console.smithi175:Power off 2023-08-08T11:16:56.755 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T11:16:56.777 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-08-08T11:16:56.777 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:16:56.796 INFO:teuthology.orchestra.console.smithi157:Power off 2023-08-08T11:16:56.797 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T11:16:56.809 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-08-08T11:16:56.821 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-08-08T11:16:56.821 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:16:56.846 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-08-08T11:17:00.812 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:00.848 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:00.923 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-08-08T11:17:00.959 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-08-08T11:17:04.928 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:04.961 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:05.038 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-08-08T11:17:05.074 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-08-08T11:17:05.139 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-08-08T11:17:05.175 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-08-08T11:17:05.242 INFO:teuthology.orchestra.console.smithi175:Power on 2023-08-08T11:17:05.242 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T11:17:05.264 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-08-08T11:17:05.265 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:05.276 INFO:teuthology.orchestra.console.smithi157:Power on 2023-08-08T11:17:05.277 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T11:17:05.288 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-08-08T11:17:05.299 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-08-08T11:17:05.299 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:05.322 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-08-08T11:17:09.292 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:09.324 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:09.403 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-08-08T11:17:09.434 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-08-08T11:17:13.408 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:13.436 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:17:13.520 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-08-08T11:17:13.546 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-08-08T11:17:13.622 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-08-08T11:17:13.647 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-08-08T11:17:13.723 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-08-08T11:17:13.724 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:17:13.748 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-08-08T11:17:13.749 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:17:28.828 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:17:28.833 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:17:43.900 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:17:43.901 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:17:58.972 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:17:58.973 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:18:14.049 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:18:14.050 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:18:29.116 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:18:29.117 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:18:44.188 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:18:44.189 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:18:59.254 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:18:59.255 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:19:14.348 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:19:14.350 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:19:29.428 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:19:29.429 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:19:44.500 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:19:44.502 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-08-08T11:19:44.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:19:47.632 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-08-08T11:19:53.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:19:56.688 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-08-08T11:19:59.568 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:20:02.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:05.744 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-08-08T11:20:11.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:14.640 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-08-08T11:20:14.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:14.804 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-08-08T11:20:17.776 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:20:20.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:23.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:23.888 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-08-08T11:20:26.832 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:20:29.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:32.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:32.944 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-08-08T11:20:35.888 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:20:38.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:41.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:42.000 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-08-08T11:20:44.944 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:20:48.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:50.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:20:54.000 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:21:00.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:21:03.056 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:21:09.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:21:12.116 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:21:18.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:21:21.200 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-08T11:21:27.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:21:48.020 WARNING:teuthology.provision.fog.smithi175:timed out 2023-08-08T11:21:54.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:21:54.242 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T11:21:54.243 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T11:21:54.506 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-08-08T11:21:54.507 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-08-08T11:21:54.526 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-08-08T11:21:54.527 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-08-08T11:21:54.586 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-08-08T11:21:54.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-08-08T11:21:54.684 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-08-08T11:21:54.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-08-08T11:21:54.782 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-08-08T11:21:54.851 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-08-08T11:21:54.919 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-08-08T11:21:54.976 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-08-08T11:21:54.977 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-08-08T11:21:54.977 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-08-08T11:21:54.977 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-08-08T11:21:54.977 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-08-08T11:21:54.977 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-08-08T11:21:54.978 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T11:21:54.978 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-08-08T11:21:54.978 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T11:21:54.978 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-08-08T11:21:54.978 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T11:21:54.978 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T11:21:54.978 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T11:21:54.979 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-08-08T11:21:54.980 DEBUG:teuthology.parallel:result is None 2023-08-08T11:22:27.236 WARNING:teuthology.provision.fog.smithi157:timed out 2023-08-08T11:22:33.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:22:33.468 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T11:22:33.468 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T11:22:33.724 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-08-08T11:22:33.724 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-08-08T11:22:33.744 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-08-08T11:22:33.745 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-08-08T11:22:33.805 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-08-08T11:22:33.805 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-08-08T11:22:33.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-08-08T11:22:33.944 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-08-08T11:22:34.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-08-08T11:22:34.092 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-08-08T11:22:34.169 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-08-08T11:22:34.227 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2023-08-08T11:22:34.228 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2023-08-08T11:22:34.228 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2023-08-08T11:22:34.228 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2023-08-08T11:22:34.228 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2023-08-08T11:22:34.228 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-08-08T11:22:34.229 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T11:22:34.229 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-08-08T11:22:34.229 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T11:22:34.229 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2023-08-08T11:22:34.229 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T11:22:34.229 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T11:22:34.229 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T11:22:34.230 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-08-08T11:22:34.232 DEBUG:teuthology.parallel:result is None 2023-08-08T11:22:34.371 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-08-08T11:22:34.372 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T11:22:34.405 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-08-08T11:22:34.405 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T11:22:34.430 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-08-08T11:22:34.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-08T11:22:34.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:22:34.496 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-08-08T11:22:34.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-08T11:22:34.563 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-08-08T11:22:34.623 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-08-08T11:22:34.624 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-08-08T11:22:34.682 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2023-08-08T11:22:34.683 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2023-08-08T11:22:34.683 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2023-08-08T11:22:34.683 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2023-08-08T11:22:34.683 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2023-08-08T11:22:34.683 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-08-08T11:22:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T11:22:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-08-08T11:22:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T11:22:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2023-08-08T11:22:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T11:22:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T11:22:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T11:22:34.685 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-08-08T11:22:34.712 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-08-08T11:22:34.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-08-08T11:22:34.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T11:22:34.781 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-08-08T11:22:34.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-08-08T11:22:34.915 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-08-08T11:22:34.975 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-08-08T11:22:34.975 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-08-08T11:22:35.034 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-08-08T11:22:35.034 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-08-08T11:22:35.034 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-08-08T11:22:35.034 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-08-08T11:22:35.034 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-08-08T11:22:35.035 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-08-08T11:22:35.035 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T11:22:35.035 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-08-08T11:22:35.035 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T11:22:35.035 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-08-08T11:22:35.035 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T11:22:35.036 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T11:22:35.036 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T11:22:35.037 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-08-08T11:22:35.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:22:35.145 INFO:teuthology.dispatcher.supervisor:Running job 7358876 2023-08-08T11:22:35.146 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_250cac13884ccaca114f617952ff3b9f286ec3e7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358876 --name yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358876/orig.config.yaml 2023-08-08T11:22:35.149 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358876 2023-08-08T11:22:35.150 INFO:teuthology.dispatcher.supervisor:Job PID: 25417 2023-08-08T11:22:35.150 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T11:24:35.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:26:35.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:28:35.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:30:35.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:32:35.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:34:36.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:36:36.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:38:36.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T11:38:36.528 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T11:38:36.633 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T11:38:36.634 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T11:38:36.677 DEBUG:teuthology.nuke:shortname: smithi157 2023-08-08T11:38:36.678 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T11:38:36.701 DEBUG:teuthology.nuke:shortname: smithi175 2023-08-08T11:38:36.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T11:38:36.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358876', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 11:16:55.191071', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBh6U2RkRyLLSXDIAM7MWZ9H85g8DNRjmFOqxGcB0OOBe3t31n+Y7Uy1+QmPtqsDS2Uwb2yfbhA/cmkhQSBf7ic='} 2023-08-08T11:38:36.728 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358876', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 11:16:55.189300', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9nYGiGrIq71lMSqIOfFT9Nu+DHPo8Vzi2W7yk8ucOHAKO8vsB/ckJg1QzNW3iAkl/1kEqZgcYeDf8iJdnoreS4KOFwq8gKmi4tHe2onbio2jashMjKL+/mq0hzMKfKbvbCuFNgvzaipB1Aydu2iXlENL/s+AlXHYs4q+7Vv2OYiJKhSSFBXj+Rzaqvqnr7BU2MjZg+c0gL7KkK1l3zzPv/PzvkadmrbgLog8eeeN0vAncTvBJaPv8IR6vOyeN5En0N0qeZhveBYaed8EEc2nA/kxjE/9tNenyhOm0jsQwCyPkWjUmv5Ga6JgpNFBPeudHMEbhckO2JFB7BB1019sIYzyTBRRPGoHGVGu+leTk5xCjHIFIinfdwNeTczJfEXZ6O3gZOQ0/HRm0p3a3CkZPYa/QJ/rrkypxo/34mcsEbhLt4AcJOW0gleMad5KYpdlpgtRyu8/Phwbmg/QkFPS9mdhlgS7ukW6Wz9XvHFYtiDJ1PBLHfgEKMU+gWK8svtM='} 2023-08-08T11:38:36.754 INFO:teuthology.orchestra.console.smithi157:Power off 2023-08-08T11:38:36.755 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T11:38:36.777 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-08-08T11:38:36.778 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:38:36.794 INFO:teuthology.orchestra.console.smithi175:Power off 2023-08-08T11:38:36.794 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T11:38:36.803 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-08-08T11:38:36.817 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-08-08T11:38:36.817 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T11:38:36.837 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-08-08T11:38:36.905 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-08-08T11:38:36.939 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-08-08T11:38:37.062 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-08-08T11:38:37.085 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com