2023-10-09T20:15:08.064 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T20:15:08.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:15:08.207 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f09880ac670>, signals=[15]) 2023-10-09T20:15:08.207 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-10-09T20:15:08.208 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-10-09T20:15:08.208 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-09T20:15:08.233 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-10-09T20:15:08.233 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-10-09T20:15:08.234 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-09T20:15:08.235 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-10-09T20:15:08.258 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-10-09T20:15:08.306 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-09T20:15:08.326 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-09T20:15:08.347 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_8.stream (ID 3) 2023-10-09T20:15:08.347 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 3} 2023-10-09T20:15:08.373 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3) 2023-10-09T20:15:08.374 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 3} 2023-10-09T20:15:08.388 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream 2023-10-09T20:15:08.388 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:15:08.420 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream 2023-10-09T20:15:08.420 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:15:08.481 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-10-09T20:15:08.490 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-10-09T20:15:08.519 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-10-09T20:15:08.533 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-10-09T20:15:08.589 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:15:08.598 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:15:08.704 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-09T20:15:08.704 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T20:15:08.716 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-09T20:15:08.717 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T20:15:08.726 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-09T20:15:08.726 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:08.736 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-09T20:15:08.736 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:08.747 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-09T20:15:08.756 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-09T20:15:08.857 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-09T20:15:08.957 INFO:teuthology.orchestra.console.smithi191:Power on 2023-10-09T20:15:08.958 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-09T20:15:08.979 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-10-09T20:15:08.979 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:09.000 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-09T20:15:12.750 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:12.858 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-09T20:15:13.001 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:13.110 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-09T20:15:16.862 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:16.971 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-09T20:15:17.111 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:17.219 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-09T20:15:17.320 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-10-09T20:15:17.421 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-10-09T20:15:17.421 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:15:21.114 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:21.222 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-09T20:15:21.323 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-09T20:15:21.424 INFO:teuthology.orchestra.console.smithi081:Power on 2023-10-09T20:15:21.424 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-09T20:15:21.447 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-10-09T20:15:21.448 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:21.472 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-09T20:15:25.474 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:25.585 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-09T20:15:29.586 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:15:29.694 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-09T20:15:29.795 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-10-09T20:15:29.896 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-10-09T20:15:29.896 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:15:32.530 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:15:45.014 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:15:47.634 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:16:00.122 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:16:02.730 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:16:15.214 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:16:17.811 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:16:30.298 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:16:32.890 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:16:45.394 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:16:47.966 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:17:00.482 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:17:03.034 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:17:15.578 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:17:18.118 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:17:30.646 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:17:33.186 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:17:45.730 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:17:48.258 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:18:00.802 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:18:03.329 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-09T20:18:03.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:15.878 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-09T20:18:15.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:21.953 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-09T20:18:27.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:31.034 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-09T20:18:34.494 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-09T20:18:37.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:40.090 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-09T20:18:40.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:43.546 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-09T20:18:46.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:49.150 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-09T20:18:49.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:52.606 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-09T20:18:55.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:18:58.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:19:01.690 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-09T20:19:07.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:19:55.202 WARNING:teuthology.provision.fog.smithi191:timed out 2023-10-09T20:20:01.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:20:01.451 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-09T20:20:01.451 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-09T20:20:01.698 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-10-09T20:20:01.699 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-10-09T20:20:01.719 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-10-09T20:20:01.719 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-10-09T20:20:01.779 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-10-09T20:20:01.779 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-10-09T20:20:01.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-10-09T20:20:01.910 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-10-09T20:20:01.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-10-09T20:20:02.047 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-10-09T20:20:02.114 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T20:20:02.172 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-09T20:20:02.173 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T20:20:02.173 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-10-09T20:20:02.173 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T20:20:02.173 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T20:20:02.173 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T20:20:02.173 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-10-09T20:20:02.175 DEBUG:teuthology.parallel:result is None 2023-10-09T20:20:07.702 WARNING:teuthology.provision.fog.smithi081:timed out 2023-10-09T20:20:13.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:20:14.035 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-09T20:20:14.036 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-09T20:20:14.329 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-10-09T20:20:14.329 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-10-09T20:20:14.348 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-10-09T20:20:14.348 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-10-09T20:20:14.408 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-10-09T20:20:14.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-09T20:20:14.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-10-09T20:20:14.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-10-09T20:20:14.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-10-09T20:20:14.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-09T20:20:14.770 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-09T20:20:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-10-09T20:20:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T20:20:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T20:20:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T20:20:14.830 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-10-09T20:20:14.830 DEBUG:teuthology.parallel:result is None 2023-10-09T20:20:14.978 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-10-09T20:20:14.978 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-09T20:20:15.006 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-10-09T20:20:15.006 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-09T20:20:15.031 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-10-09T20:20:15.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-09T20:20:15.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:20:15.095 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-09T20:20:15.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-09T20:20:15.163 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-09T20:20:15.220 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-09T20:20:15.220 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-09T20:20:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-10-09T20:20:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-10-09T20:20:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-10-09T20:20:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-10-09T20:20:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-10-09T20:20:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-09T20:20:15.279 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T20:20:15.279 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-09T20:20:15.279 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T20:20:15.279 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-10-09T20:20:15.279 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T20:20:15.279 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T20:20:15.279 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T20:20:15.280 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-09T20:20:15.297 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-10-09T20:20:15.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-09T20:20:15.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T20:20:15.367 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-09T20:20:15.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-09T20:20:15.501 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-10-09T20:20:15.561 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-10-09T20:20:15.561 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-09T20:20:15.620 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T20:20:15.621 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T20:20:15.622 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T20:20:15.622 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-09T20:20:15.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:20:15.733 INFO:teuthology.dispatcher.supervisor:Running job 7419013 2023-10-09T20:20:15.733 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-09_19:34:32-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7419013 --name yuriw-2023-10-09_19:34:32-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{bucket-check cls ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-10-09_19:34:32-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7419013/orig.config.yaml 2023-10-09T20:20:15.736 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-09_19:34:32-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7419013 2023-10-09T20:20:15.736 INFO:teuthology.dispatcher.supervisor:Job PID: 2017694 2023-10-09T20:20:15.736 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-09T20:22:15.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:24:16.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:26:16.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:28:16.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:30:16.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:32:16.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:34:16.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:36:16.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:38:17.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:40:17.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:42:17.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:44:17.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:46:17.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:48:17.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:50:17.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:52:18.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:54:18.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:56:18.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:58:18.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T20:58:18.691 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-09T20:58:18.797 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-09T20:58:18.797 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T20:58:18.847 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-09T20:58:18.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T20:58:18.867 DEBUG:teuthology.nuke:shortname: smithi191 2023-10-09T20:58:18.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T20:58:18.870 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-09_19:34:32-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7419013', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 20:15:07.251597', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5ydU+Hn4r1YbmD6whRgrQFTYvAy5+41NS1gO82gz+d2+g3miKaxuKuT9Mlx5MFssnfRR9uxZUxS68EGKOuP10='} 2023-10-09T20:58:18.898 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-09_19:34:32-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7419013', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 20:15:07.253575', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZfpy4zHTksOj1EqVHI0KhLzFN17lSi9BSMH1eN5yG9PJJtCo+LsQe2wKops18cahAnO4n+ZqHVoWl5KCF6A2U='} 2023-10-09T20:58:18.927 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-09T20:58:18.928 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T20:58:18.949 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-09T20:58:18.949 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:58:18.963 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-09T20:58:18.963 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T20:58:18.971 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-09T20:58:18.983 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-09T20:58:18.984 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T20:58:19.003 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-09T20:58:19.073 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-09T20:58:19.104 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-09T20:58:19.223 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2023-10-09T20:58:19.248 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com