2023-08-30T09:20:18.369 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-30T09:20:18.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T09:20:18.514 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9e79961f0>, signals=[15]) 2023-08-30T09:20:18.515 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-08-30T09:20:18.516 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T09:20:18.516 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-30T09:20:18.537 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-08-30T09:20:18.538 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T09:20:18.538 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-08-30T09:20:18.539 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-08-30T09:20:18.563 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-08-30T09:20:18.614 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T09:20:18.633 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T09:20:18.661 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T09:20:18.661 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 10} 2023-08-30T09:20:18.684 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T09:20:18.684 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 10} 2023-08-30T09:20:18.707 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 9.stream 2023-08-30T09:20:18.708 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:20:18.737 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 9.stream 2023-08-30T09:20:18.738 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:20:18.777 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T09:20:18.801 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T09:20:18.817 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-08-30T09:20:18.840 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-08-30T09:20:18.871 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:20:18.888 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:20:18.980 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-30T09:20:18.981 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:20:19.003 INFO:teuthology.orchestra.console.smithi155:Power off 2023-08-30T09:20:19.004 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:20:19.014 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-30T09:20:19.015 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:20:19.029 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-08-30T09:20:19.030 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:20:19.040 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T09:20:19.054 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-08-30T09:20:19.141 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-30T09:20:19.156 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-08-30T09:20:19.243 INFO:teuthology.orchestra.console.smithi141:Power on 2023-08-30T09:20:19.243 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T09:20:19.257 INFO:teuthology.orchestra.console.smithi155:Power on 2023-08-30T09:20:19.257 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T09:20:19.266 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-08-30T09:20:19.266 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:20:19.278 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-08-30T09:20:19.279 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:20:19.291 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T09:20:19.305 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-08-30T09:20:23.297 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:20:23.307 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:20:23.409 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T09:20:23.417 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-08-30T09:20:23.517 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-08-30T09:20:23.618 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-08-30T09:20:23.619 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:20:27.414 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:20:27.540 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-30T09:20:27.641 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-08-30T09:20:27.742 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-08-30T09:20:27.743 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:20:38.706 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:20:42.822 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:20:53.790 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:20:57.906 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:21:08.870 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:21:12.988 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:21:23.954 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:21:28.086 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:21:39.038 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:21:43.186 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:21:54.150 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:21:58.290 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:22:09.251 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:22:13.370 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:22:24.359 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:22:28.474 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:22:39.470 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:22:43.570 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:22:54.590 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:22:58.662 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T09:22:58.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:01.818 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T09:23:07.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:09.668 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-08-30T09:23:09.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:10.874 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T09:23:12.830 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-30T09:23:16.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:18.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:19.930 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T09:23:21.914 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-30T09:23:25.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:27.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:28.986 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T09:23:30.970 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-30T09:23:34.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:36.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:38.046 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T09:23:40.026 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-30T09:23:44.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:46.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:47.130 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T09:23:49.082 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-30T09:23:53.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:55.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:23:56.186 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T09:23:58.138 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-30T09:24:02.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:24:04.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:25:02.251 WARNING:teuthology.provision.fog.smithi141:timed out 2023-08-30T09:25:04.146 WARNING:teuthology.provision.fog.smithi155:timed out 2023-08-30T09:25:08.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:25:08.583 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T09:25:08.584 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T09:25:08.899 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-08-30T09:25:08.900 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-08-30T09:25:08.913 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-08-30T09:25:08.914 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-08-30T09:25:08.964 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-08-30T09:25:08.965 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-30T09:25:09.062 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-08-30T09:25:09.089 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-08-30T09:25:09.156 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-08-30T09:25:09.221 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-30T09:25:09.286 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-30T09:25:09.340 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-08-30T09:25:09.340 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-08-30T09:25:09.340 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-08-30T09:25:09.340 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-08-30T09:25:09.341 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-08-30T09:25:09.341 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-08-30T09:25:09.341 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T09:25:09.341 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-08-30T09:25:09.341 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-08-30T09:25:09.342 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T09:25:09.342 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-08-30T09:25:09.342 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T09:25:09.342 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T09:25:09.342 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T09:25:09.343 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-08-30T09:25:09.345 DEBUG:teuthology.parallel:result is None 2023-08-30T09:25:10.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:25:10.437 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T09:25:10.437 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T09:25:10.774 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-08-30T09:25:10.775 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-08-30T09:25:10.789 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-08-30T09:25:10.789 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-08-30T09:25:10.845 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-08-30T09:25:10.846 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-08-30T09:25:10.956 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-08-30T09:25:10.984 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-08-30T09:25:11.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-08-30T09:25:11.120 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-08-30T09:25:11.186 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-08-30T09:25:11.243 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-08-30T09:25:11.243 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-08-30T09:25:11.244 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-08-30T09:25:11.244 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-08-30T09:25:11.244 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-08-30T09:25:11.244 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-08-30T09:25:11.244 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T09:25:11.245 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-08-30T09:25:11.245 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-08-30T09:25:11.245 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T09:25:11.245 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-08-30T09:25:11.245 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T09:25:11.246 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T09:25:11.246 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T09:25:11.246 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-08-30T09:25:11.247 DEBUG:teuthology.parallel:result is None 2023-08-30T09:25:11.429 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-08-30T09:25:11.429 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T09:25:11.449 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-08-30T09:25:11.449 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T09:25:11.466 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-08-30T09:25:11.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-30T09:25:11.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:25:11.555 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-30T09:25:11.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-30T09:25:11.621 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-08-30T09:25:11.675 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-08-30T09:25:11.675 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-30T09:25:11.730 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-08-30T09:25:11.730 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-08-30T09:25:11.731 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-08-30T09:25:11.731 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-08-30T09:25:11.731 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-08-30T09:25:11.731 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-08-30T09:25:11.731 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T09:25:11.732 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-08-30T09:25:11.732 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-08-30T09:25:11.732 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T09:25:11.732 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-08-30T09:25:11.732 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T09:25:11.733 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T09:25:11.733 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T09:25:11.733 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-30T09:25:11.758 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-08-30T09:25:11.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-30T09:25:11.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:25:11.839 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-08-30T09:25:11.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-30T09:25:11.905 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-08-30T09:25:11.959 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-08-30T09:25:11.960 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-08-30T09:25:12.015 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-08-30T09:25:12.015 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-08-30T09:25:12.015 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-08-30T09:25:12.016 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-08-30T09:25:12.016 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-08-30T09:25:12.016 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-08-30T09:25:12.016 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T09:25:12.016 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-08-30T09:25:12.017 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-08-30T09:25:12.017 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T09:25:12.017 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-08-30T09:25:12.017 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T09:25:12.017 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T09:25:12.018 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T09:25:12.018 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-08-30T09:25:12.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T09:25:12.129 INFO:teuthology.dispatcher.supervisor:Running job 7382624 2023-08-30T09:25:12.130 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382624 --name mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382624/orig.config.yaml 2023-08-30T09:25:12.133 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382624 2023-08-30T09:25:12.133 INFO:teuthology.dispatcher.supervisor:Job PID: 9967 2023-08-30T09:25:12.133 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T09:27:12.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T09:27:12.289 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T09:27:12.390 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T09:27:12.390 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T09:27:12.436 DEBUG:teuthology.nuke:shortname: smithi141 2023-08-30T09:27:12.436 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T09:27:12.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 09:20:17.518825', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFECC5pcbvmiPRTjVIrY7hGkchvf0t2W7srYwrGutaxV0uVgsRnTsq/qC67lLy/qUYODrcFMt0pGiGDYvGxBtjQ='} 2023-08-30T09:27:12.464 DEBUG:teuthology.nuke:shortname: smithi155 2023-08-30T09:27:12.465 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T09:27:12.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 09:20:17.520654', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxvAM2YxH54GUOiuL5tsqC9+Qrj1WUie9rYm4hhdEZvw3gJzJRo9tSTe12ZOcK5pPYOLdoywDaGd7bp5TsBO6c='} 2023-08-30T09:27:12.515 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-30T09:27:12.515 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:27:12.543 INFO:teuthology.orchestra.console.smithi155:Power off 2023-08-30T09:27:12.544 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:27:12.552 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-30T09:27:12.552 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:27:12.564 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-08-30T09:27:12.564 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:27:12.573 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T09:27:12.587 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-08-30T09:27:12.674 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-30T09:27:12.688 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-08-30T09:27:12.828 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2023-08-30T09:27:12.836 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com