2023-10-01T07:04:28.579 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-01T07:04:28.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:04:28.724 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f41d26d0f70>, signals=[15]) 2023-10-01T07:04:28.725 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-10-01T07:04:28.725 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T07:04:28.725 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-01T07:04:28.746 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-10-01T07:04:28.746 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T07:04:28.747 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-01T07:04:28.748 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-10-01T07:04:28.771 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"} 2023-10-01T07:04:28.835 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-01T07:04:28.845 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-01T07:04:28.888 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_8.stream (ID 3) 2023-10-01T07:04:28.888 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 3} 2023-10-01T07:04:28.896 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2023-10-01T07:04:28.896 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 3} 2023-10-01T07:04:28.946 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 8.stream 2023-10-01T07:04:28.946 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:04:28.950 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2023-10-01T07:04:28.951 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:04:29.018 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T07:04:29.022 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T07:04:29.061 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-10-01T07:04:29.065 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1} 2023-10-01T07:04:29.116 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:04:29.126 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:04:29.206 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-01T07:04:29.207 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T07:04:29.219 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-01T07:04:29.219 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T07:04:29.228 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-01T07:04:29.228 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:04:29.240 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-01T07:04:29.240 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:04:29.250 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-01T07:04:29.261 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-01T07:04:29.351 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-01T07:04:29.362 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-01T07:04:29.452 INFO:teuthology.orchestra.console.smithi161:Power on 2023-10-01T07:04:29.452 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T07:04:29.466 INFO:teuthology.orchestra.console.smithi175:Power on 2023-10-01T07:04:29.466 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T07:04:29.480 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-10-01T07:04:29.480 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:04:29.492 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-10-01T07:04:29.493 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:04:29.509 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-01T07:04:29.521 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-01T07:04:33.510 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:04:33.522 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:04:33.622 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-01T07:04:33.631 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-01T07:04:33.723 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-10-01T07:04:33.823 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-10-01T07:04:33.824 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:04:37.635 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:04:37.746 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-01T07:04:37.847 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-10-01T07:04:37.948 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-10-01T07:04:37.948 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:04:48.894 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:04:53.014 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:05:03.970 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:05:08.078 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:05:19.042 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:05:23.138 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:05:34.126 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:05:38.198 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:05:49.198 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:05:53.258 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:06:04.266 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:06:08.322 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:06:19.338 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:06:23.385 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:06:34.409 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:06:38.449 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:06:49.478 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:06:53.514 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:07:04.534 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:07:08.582 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:07:19.599 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-01T07:07:19.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:22.714 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-01T07:07:23.640 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-01T07:07:23.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:26.750 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-01T07:07:28.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:31.774 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-01T07:07:32.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:35.806 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-01T07:07:37.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:40.830 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-01T07:07:41.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:44.858 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-01T07:07:46.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:49.914 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-01T07:07:50.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:53.918 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-01T07:07:55.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:07:58.974 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-01T07:07:59.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:08:02.977 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-01T07:08:04.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:08:08.058 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-01T07:08:08.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:08:12.062 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-01T07:08:14.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:08:17.114 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-01T07:08:18.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:08:23.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:08:50.033 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T07:08:50.034 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T07:09:14.853 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-10-01T07:09:14.853 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-10-01T07:09:14.878 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-10-01T07:09:14.879 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-10-01T07:09:14.940 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-10-01T07:09:14.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-01T07:09:15.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-10-01T07:09:15.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-10-01T07:09:15.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-10-01T07:09:15.239 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-01T07:09:15.308 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-01T07:09:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-10-01T07:09:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-10-01T07:09:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-10-01T07:09:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:09:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:09:15.368 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-10-01T07:09:15.369 DEBUG:teuthology.parallel:result is None 2023-10-01T07:09:23.129 WARNING:teuthology.provision.fog.smithi161:timed out 2023-10-01T07:09:29.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:09:29.384 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T07:09:29.385 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T07:09:29.626 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-10-01T07:09:29.626 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-10-01T07:09:29.645 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-10-01T07:09:29.645 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-10-01T07:09:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-10-01T07:09:29.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-01T07:09:29.807 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-10-01T07:09:29.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-10-01T07:09:29.903 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-10-01T07:09:29.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-01T07:09:30.038 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-01T07:09:30.096 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-10-01T07:09:30.096 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-10-01T07:09:30.096 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-10-01T07:09:30.096 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:09:30.096 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:09:30.097 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:09:30.097 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-10-01T07:09:30.098 DEBUG:teuthology.parallel:result is None 2023-10-01T07:09:30.292 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-10-01T07:09:30.292 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T07:09:30.320 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-10-01T07:09:30.320 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T07:09:30.345 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-10-01T07:09:30.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-01T07:09:30.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:09:30.415 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-10-01T07:09:30.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-01T07:09:30.489 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-10-01T07:09:30.546 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-10-01T07:09:30.546 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-01T07:09:30.604 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-10-01T07:09:30.604 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-10-01T07:09:30.604 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-10-01T07:09:30.604 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:09:30.604 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:09:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:09:30.606 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-01T07:09:30.628 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-10-01T07:09:30.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-01T07:09:30.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:09:30.696 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-10-01T07:09:30.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-01T07:09:30.831 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-10-01T07:09:30.890 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-10-01T07:09:30.890 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:09:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:09:30.950 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:09:30.950 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:09:30.950 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-01T07:09:30.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:09:31.067 INFO:teuthology.dispatcher.supervisor:Running job 7407903 2023-10-01T07:09:31.067 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407903 --name teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407903/orig.config.yaml 2023-10-01T07:09:31.070 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407903 2023-10-01T07:09:31.070 INFO:teuthology.dispatcher.supervisor:Job PID: 477275 2023-10-01T07:09:31.070 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-01T07:11:31.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:13:31.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:15:31.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:17:31.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:19:31.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:21:32.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:23:32.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:25:32.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:27:32.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:29:32.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:31:32.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:33:33.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:35:33.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:37:33.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:39:33.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:41:33.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:43:33.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:45:34.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:47:34.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:49:34.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:51:34.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:53:34.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:55:34.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:57:34.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:59:35.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:01:35.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:03:35.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:05:35.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:07:35.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:09:35.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:11:36.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:13:36.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:15:36.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:17:36.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:19:36.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:21:36.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:23:37.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:25:37.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:27:37.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:29:37.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:31:37.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:31:39.623 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-01T08:31:39.946 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-01T08:31:39.947 INFO:teuthology.nuke:Checking targets against current locks 2023-10-01T08:31:40.003 DEBUG:teuthology.nuke:shortname: smithi161 2023-10-01T08:31:40.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T08:31:40.025 DEBUG:teuthology.nuke:shortname: smithi175 2023-10-01T08:31:40.025 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T08:31:40.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:04:27.686458', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNIpgfI0vzRdt4YIl/ysiCwNUvr09OJ6tSOfGlyprger4XWKa0WEumm9LdVu4EeEJ1W1JSvlFQVcz/kyZYt6cE='} 2023-10-01T08:31:40.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:04:27.687892', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCKbAehnron0getHNxzJSIhtSkA7zYLpxtISXxwWV19MCuNmc4szbPIFQnxMQpcz1Mcrbrkks+zLP38nmZY0QE='} 2023-10-01T08:31:40.078 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-01T08:31:40.079 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T08:31:40.099 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-01T08:31:40.099 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:31:40.113 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-01T08:31:40.113 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T08:31:40.124 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-01T08:31:40.132 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-01T08:31:40.133 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:31:40.154 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-01T08:31:40.225 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-01T08:31:40.255 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-01T08:31:40.381 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2023-10-01T08:31:40.404 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com