2023-08-28T17:57:27.973 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-28T17:57:27.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T17:57:28.090 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f29cff7e1f0>, signals=[15]) 2023-08-28T17:57:28.091 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-08-28T17:57:28.091 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T17:57:28.091 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-08-28T17:57:28.113 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-08-28T17:57:28.113 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T17:57:28.113 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-08-28T17:57:28.114 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /host {"name": "smithi037"} 2023-08-28T17:57:28.138 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-08-28T17:57:28.181 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-28T17:57:28.200 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-28T17:57:28.219 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_8.stream (ID 3) 2023-08-28T17:57:28.219 DEBUG:teuthology.provision.fog.smithi037:FOG request: PUT /host/142 {"imageID": 3} 2023-08-28T17:57:28.244 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_8.stream (ID 3) 2023-08-28T17:57:28.245 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 3} 2023-08-28T17:57:28.271 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream 2023-08-28T17:57:28.271 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:57:28.295 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2023-08-28T17:57:28.295 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:57:28.449 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T17:57:28.469 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T17:57:28.493 DEBUG:teuthology.provision.fog.smithi037:FOG request: POST /host/142/task {"taskTypeID": 1} 2023-08-28T17:57:28.503 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-08-28T17:57:28.551 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:57:28.561 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:57:28.779 INFO:teuthology.orchestra.console.smithi163:Power off 2023-08-28T17:57:28.779 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T17:57:28.789 INFO:teuthology.orchestra.console.smithi037:Power off 2023-08-28T17:57:28.790 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T17:57:28.798 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-08-28T17:57:28.798 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:28.810 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-08-28T17:57:28.811 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:28.818 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-28T17:57:28.829 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-28T17:57:28.919 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-08-28T17:57:28.930 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-08-28T17:57:29.019 INFO:teuthology.orchestra.console.smithi163:Power on 2023-08-28T17:57:29.020 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T17:57:29.031 INFO:teuthology.orchestra.console.smithi037:Power on 2023-08-28T17:57:29.031 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T17:57:29.038 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-08-28T17:57:29.038 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:29.051 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-08-28T17:57:29.051 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:29.057 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-28T17:57:29.070 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-28T17:57:33.062 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:33.070 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:33.170 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-28T17:57:33.177 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-28T17:57:37.175 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:37.181 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:37.289 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-28T17:57:37.389 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-08-28T17:57:37.390 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-08-28T17:57:37.490 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-08-28T17:57:37.490 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:57:37.493 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-08-28T17:57:37.594 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-08-28T17:57:37.594 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:57:53.443 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:57:53.752 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:58:09.517 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:58:09.519 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:58:28.225 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:58:28.618 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:58:46.124 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:58:47.067 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:59:02.410 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:59:04.258 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:59:17.836 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:59:20.207 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:59:33.282 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:59:37.835 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T17:59:49.497 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T17:59:55.292 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:00:08.402 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:00:10.787 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:00:27.682 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:00:27.973 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:00:45.603 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:00:45.604 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:01:02.926 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:01:02.993 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:01:21.116 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:01:21.119 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:01:37.811 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:01:37.856 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:01:54.083 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:01:54.144 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:02:10.339 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-28T18:02:10.340 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-28T18:02:11.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:11.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:14.363 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:02:14.427 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:02:20.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:20.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:23.451 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:02:23.483 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:02:29.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:29.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:32.539 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:02:32.540 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:02:38.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:38.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:41.595 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:02:41.596 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:02:47.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:47.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:50.683 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:02:50.684 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:02:56.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:56.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:02:59.771 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:02:59.772 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:03:05.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:05.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:08.827 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:03:11.867 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:03:14.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:17.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:17.883 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:03:20.927 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:03:23.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:26.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:26.939 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:03:30.015 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-28T18:03:32.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:36.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:38.690 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T18:03:38.691 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T18:03:43.291 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:03:49.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:03:52.347 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:03:53.941 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-08-28T18:03:53.941 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-08-28T18:03:54.004 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2023-08-28T18:03:54.004 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2023-08-28T18:03:54.066 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2023-08-28T18:03:54.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-08-28T18:03:54.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2023-08-28T18:03:54.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2023-08-28T18:03:54.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2023-08-28T18:03:54.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-08-28T18:03:54.424 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-08-28T18:03:54.483 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:03:54.484 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:03:54.485 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:03:54.485 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-08-28T18:03:54.486 DEBUG:teuthology.parallel:result is None 2023-08-28T18:03:58.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:04:01.403 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-28T18:04:07.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:04:07.619 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T18:04:07.620 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T18:04:27.957 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-08-28T18:04:27.958 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-08-28T18:04:27.980 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2023-08-28T18:04:27.981 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2023-08-28T18:04:28.040 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2023-08-28T18:04:28.040 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-08-28T18:04:28.164 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2023-08-28T18:04:28.195 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2023-08-28T18:04:28.264 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2023-08-28T18:04:28.332 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-08-28T18:04:28.398 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:04:28.457 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:04:28.458 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:04:28.458 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:04:28.458 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:04:28.458 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2023-08-28T18:04:28.458 DEBUG:teuthology.parallel:result is None 2023-08-28T18:04:28.611 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-08-28T18:04:28.611 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T18:04:28.628 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2023-08-28T18:04:28.628 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T18:04:28.646 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-08-28T18:04:28.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-28T18:04:28.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:04:28.714 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-08-28T18:04:28.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-28T18:04:28.859 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-08-28T18:04:28.919 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-08-28T18:04:28.919 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-08-28T18:04:28.979 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-08-28T18:04:28.979 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2023-08-28T18:04:28.979 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-08-28T18:04:28.979 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:04:28.979 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2023-08-28T18:04:28.979 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:04:28.980 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:04:28.980 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-08-28T18:04:28.980 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:04:28.980 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:04:28.980 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:04:28.980 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:04:28.980 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:04:28.980 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-08-28T18:04:29.004 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2023-08-28T18:04:29.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-08-28T18:04:29.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:04:29.070 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-08-28T18:04:29.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-08-28T18:04:29.143 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-08-28T18:04:29.203 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-08-28T18:04:29.204 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-08-28T18:04:29.263 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:04:29.264 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:04:29.264 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:04:29.264 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:04:29.264 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:04:29.264 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-08-28T18:04:29.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:04:29.375 INFO:teuthology.dispatcher.supervisor:Running job 7382290 2023-08-28T18:04:29.376 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382290 --name adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382290/orig.config.yaml 2023-08-28T18:04:29.378 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382290 2023-08-28T18:04:29.378 INFO:teuthology.dispatcher.supervisor:Job PID: 29339 2023-08-28T18:04:29.379 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-28T18:06:29.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:08:29.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:10:29.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:12:29.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:14:30.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:16:30.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:18:30.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:20:30.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:22:31.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:24:31.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:26:31.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:28:31.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:30:31.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:30:31.674 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-08-28T18:30:31.769 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-28T18:30:31.775 INFO:teuthology.nuke:Checking targets against current locks 2023-08-28T18:30:31.821 DEBUG:teuthology.nuke:shortname: smithi037 2023-08-28T18:30:31.842 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T18:30:31.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382290', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 17:57:27.256274', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMiE8vy5LiITAc1TX+DNIwZY03QB/hr3FJDJt7PQ/yZ+e1nkaN6DhYiuYFmLGlKDZGJGUCtRIcUVZ/q38Mohc9ld4GOWIa14Lwdwo1CxYCHJcjHvGPVAQLdv0bFP3oKri/uMQIz0gRHJS6Wa59hEFeOd7vezD9MRHF1Vm6hjOZjzJq3Wz1yGhiwHlDRg5rRzolHMSHUvUYMsTidd0ucV0FQIW2BBQwJ9sS1ngetWcAMPW//B2mdj7YPxXGLgQgcbZZd4wNHw5gDfzg+7wOsiveu+xG4fHTynxcV3HqgHrQt4gOoXscum/U1dzkH7fpup9f+tWAoyAujfndFgcyh48IIO6/fFc+ymboC+o3cSLutiTz8iSXAGoX703he4AKf8+Q6C9ZQGpAzSYjBNLM65+YaRbRWTlwRLtL9216NmpI7X+tIexsILMYizSJ8N4K3nRA9gd0TwFQS+wbISYe7kXfalkILOeDFmQDqvrPWZ7OZ1Z/WikNAJ7rowvzkN84gKU='} 2023-08-28T18:30:31.886 DEBUG:teuthology.nuke:shortname: smithi163 2023-08-28T18:30:31.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T18:30:31.910 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382290', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 17:57:27.254499', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKx5xmeniosdm1+RwioAEvdkHh3qQ9DdEfvxD8E08f3xVmMngUT1bEvOPs4HyC+m87S2s7YLY0r92EehBAx+gHpGGLiekIoV7SvwNc+D0CNlVwtnH98zkSdjgoj+pccL+i3gXGHLA0h8DRBqBJoeBGp6FYdBtPtwTLxW5m/ppTBf/9ZICMfMF9eFsqNJktbl6Mf7Xjns8BUQigBI+Pow2room+I3ihQg6Qsj4NEO8GLL8kzn78GWX1w5WIHGxrsVfZGpyiMpGGnwe0tS1dMZqGotFf5Ps7gjGzXXg+JA5RJYf8CNqrJ208/gmoMCg6YE9cjIBkI4EuztnRCISjleHmeoG+E9GimI96s+S/NzYkaYJXHa4xyYgVnhWNwzPJkEYg7o4qo8Dk8lhFa+sxGjgeIx5Y485O4lnzeY6hhNBMrCov/rekd0nQvz+FKEGrDY/PHN/KGtTEQiskzhGU8w9z3GJ9/zRQv3PC8TARYAMWzIw48XsDUavBQhKD7OIeG5c='} 2023-08-28T18:30:31.950 INFO:teuthology.orchestra.console.smithi037:Power off 2023-08-28T18:30:31.951 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T18:30:31.970 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-08-28T18:30:31.996 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T18:30:32.007 INFO:teuthology.orchestra.console.smithi163:Power off 2023-08-28T18:30:32.008 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T18:30:32.015 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-28T18:30:32.027 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-08-28T18:30:32.027 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T18:30:32.046 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-28T18:30:32.116 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-08-28T18:30:32.154 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-08-28T18:30:32.265 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2023-08-28T18:30:32.315 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com