2023-08-28T19:37:23.098 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-28T19:37:23.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T19:37:23.454 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9805adf1f0>, signals=[15]) 2023-08-28T19:37:23.513 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2023-08-28T19:37:23.514 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T19:37:23.515 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-08-28T19:37:23.547 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-08-28T19:37:23.910 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T19:37:23.910 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-08-28T19:37:23.911 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"} 2023-08-28T19:37:23.939 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-08-28T19:37:24.144 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-28T19:37:24.184 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10) 2023-08-28T19:37:24.309 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 10} 2023-08-28T19:37:24.538 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-28T19:37:24.782 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10) 2023-08-28T19:37:25.104 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 10} 2023-08-28T19:37:25.110 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream 2023-08-28T19:37:25.110 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:37:25.164 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream 2023-08-28T19:37:25.267 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:37:25.272 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T19:37:25.324 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1} 2023-08-28T19:37:25.462 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T19:37:25.509 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-08-28T19:37:25.656 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:37:26.122 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:37:26.666 INFO:teuthology.orchestra.console.smithi120:Power off 2023-08-28T19:37:26.803 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:37:26.828 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2023-08-28T19:37:26.828 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:26.849 INFO:teuthology.orchestra.console.smithi191:Power off 2023-08-28T19:37:26.993 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:37:27.002 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-08-28T19:37:27.399 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-08-28T19:37:27.399 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:27.422 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-08-28T19:37:31.399 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:31.735 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:31.900 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-08-28T19:37:32.230 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-08-28T19:37:36.231 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:36.415 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:36.517 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-08-28T19:37:36.616 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-08-28T19:37:36.715 INFO:teuthology.orchestra.console.smithi120:Power off completed 2023-08-28T19:37:36.782 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-08-28T19:37:36.883 INFO:teuthology.orchestra.console.smithi120:Power on 2023-08-28T19:37:36.947 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T19:37:36.956 INFO:teuthology.orchestra.console.smithi191:Power on 2023-08-28T19:37:37.099 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T19:37:37.112 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2023-08-28T19:37:37.120 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:37.129 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-08-28T19:37:37.456 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:37.466 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-08-28T19:37:37.480 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-08-28T19:37:41.470 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:41.745 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-08-28T19:37:41.937 INFO:teuthology.orchestra.console.smithi120:Power on completed 2023-08-28T19:37:42.144 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2023-08-28T19:37:42.247 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:37:42.568 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:37:42.727 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-08-28T19:37:43.068 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-08-28T19:37:43.261 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-08-28T19:37:43.378 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:37:57.335 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:37:58.452 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:38:12.411 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:38:13.521 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:38:27.491 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:38:28.598 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:38:42.573 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:38:43.673 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:38:57.671 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:38:58.754 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:39:12.775 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:39:13.835 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:39:27.907 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:39:28.915 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:39:43.019 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:39:44.008 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:39:58.104 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:39:59.088 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:40:13.187 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-28T19:40:13.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:40:13.499 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: Authentication failed. 2023-08-28T19:40:13.500 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T19:40:13.500 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T19:40:13.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-28T19:40:14.174 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-28T19:40:14.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:40:17.307 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-28T19:40:23.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:40:26.363 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-28T19:40:32.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:40:35.707 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-28T19:40:41.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:40:45.051 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-28T19:40:51.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:40:54.107 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-28T19:41:00.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:41:03.387 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-28T19:41:09.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:41:12.443 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-28T19:41:18.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:42:09.980 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-28T19:42:10.488 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi120 2023-08-28T19:42:18.451 WARNING:teuthology.provision.fog.smithi191:timed out 2023-08-28T19:42:19.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-08-28T19:42:19.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:42:19.745 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-08-28T19:42:20.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-08-28T19:42:20.064 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T19:42:20.064 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T19:42:20.079 INFO:teuthology.provision.fog.smithi120:Node is ready 2023-08-28T19:42:20.092 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2023-08-28T19:42:20.133 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2023-08-28T19:42:20.232 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2023-08-28T19:42:20.247 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2023-08-28T19:42:20.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-08-28T19:42:20.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2023-08-28T19:42:20.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2023-08-28T19:42:20.476 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2023-08-28T19:42:20.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-08-28T19:42:20.654 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-08-28T19:42:20.736 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2023-08-28T19:42:20.759 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2023-08-28T19:42:20.759 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2023-08-28T19:42:20.759 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:42:20.759 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2023-08-28T19:42:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:42:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:42:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-08-28T19:42:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:42:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:42:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:42:20.762 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:42:20.763 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:42:20.763 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:42:20.764 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2023-08-28T19:42:20.765 DEBUG:teuthology.parallel:result is None 2023-08-28T19:42:24.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:42:24.995 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T19:42:25.041 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T19:42:25.304 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-08-28T19:42:25.331 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-08-28T19:42:25.347 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-08-28T19:42:25.348 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-08-28T19:42:25.405 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-08-28T19:42:25.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-08-28T19:42:25.526 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-08-28T19:42:25.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-08-28T19:42:25.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-08-28T19:42:25.690 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-08-28T19:42:25.756 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-08-28T19:42:25.813 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:42:25.814 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:42:25.814 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:42:25.814 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:42:25.814 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:42:25.814 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:42:25.814 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-08-28T19:42:25.815 DEBUG:teuthology.parallel:result is None 2023-08-28T19:42:25.973 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2023-08-28T19:42:25.974 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T19:42:25.995 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-08-28T19:42:25.996 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T19:42:26.021 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2023-08-28T19:42:26.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-08-28T19:42:26.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:42:26.107 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-08-28T19:42:26.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-08-28T19:42:26.176 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-08-28T19:42:26.232 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-08-28T19:42:26.232 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-08-28T19:42:26.289 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2023-08-28T19:42:26.289 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2023-08-28T19:42:26.289 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2023-08-28T19:42:26.289 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:42:26.289 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2023-08-28T19:42:26.289 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:42:26.290 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:42:26.291 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-08-28T19:42:26.291 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:42:26.291 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:42:26.291 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:42:26.291 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:42:26.291 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:42:26.291 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:42:26.291 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-08-28T19:42:26.312 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-08-28T19:42:26.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-08-28T19:42:26.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:42:26.393 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-08-28T19:42:26.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-08-28T19:42:26.462 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-08-28T19:42:26.517 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-08-28T19:42:26.517 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:42:26.572 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-08-28T19:42:26.573 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:42:26.573 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:42:26.573 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:42:26.574 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:42:26.574 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:42:26.574 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:42:26.574 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-08-28T19:42:26.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T19:42:26.746 INFO:teuthology.dispatcher.supervisor:Running job 7382244 2023-08-28T19:42:26.746 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382244 --name mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382244/orig.config.yaml 2023-08-28T19:42:26.751 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382244 2023-08-28T19:42:26.751 INFO:teuthology.dispatcher.supervisor:Job PID: 1643602 2023-08-28T19:42:26.751 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-28T19:44:26.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T19:44:26.931 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-08-28T19:44:27.041 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-28T19:44:27.042 INFO:teuthology.nuke:Checking targets against current locks 2023-08-28T19:44:27.084 DEBUG:teuthology.nuke:shortname: smithi120 2023-08-28T19:44:27.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T19:44:27.101 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 19:37:22.156348', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdNwSEifv7FYSIp66KdDMqMdI6/h8r3SIrJVbkO0RAWndNYghjh9+oFx3LcPNHAWBTldeaWdXwi8VB6hy2ZG9w='} 2023-08-28T19:44:27.108 DEBUG:teuthology.nuke:shortname: smithi191 2023-08-28T19:44:27.108 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T19:44:27.129 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 19:37:22.158040', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObgulgdVh1wttcOcmgYu3D020Ial9bLYSrgIAquOpoMVFo7XxiFBpXqdzOzLiDurAze8LNclupJS3UXNU6xXpQ='} 2023-08-28T19:44:27.141 INFO:teuthology.orchestra.console.smithi120:Power off 2023-08-28T19:44:27.142 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:44:27.161 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2023-08-28T19:44:27.161 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:44:27.181 INFO:teuthology.orchestra.console.smithi191:Power off 2023-08-28T19:44:27.182 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:44:27.189 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-08-28T19:44:27.201 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-08-28T19:44:27.202 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:44:27.221 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-08-28T19:44:27.291 INFO:teuthology.orchestra.console.smithi120:Power off completed 2023-08-28T19:44:27.322 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-08-28T19:44:27.439 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2023-08-28T19:44:27.463 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com