2023-10-01T12:30:17.708 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-01T12:30:17.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:30:17.963 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f14b4510670>, signals=[15]) 2023-10-01T12:30:17.979 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2023-10-01T12:30:17.979 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T12:30:17.979 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-10-01T12:30:18.005 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-10-01T12:30:18.006 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T12:30:18.006 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-01T12:30:18.007 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"} 2023-10-01T12:30:18.022 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-10-01T12:30:18.074 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-01T12:30:18.152 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-01T12:30:18.194 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10) 2023-10-01T12:30:18.313 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 10} 2023-10-01T12:30:18.316 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_9.stream (ID 10) 2023-10-01T12:30:18.316 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 10} 2023-10-01T12:30:18.363 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 9.stream 2023-10-01T12:30:18.627 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:30:18.632 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream 2023-10-01T12:30:18.632 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:30:18.692 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T12:30:18.787 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T12:30:18.832 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1} 2023-10-01T12:30:18.837 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-10-01T12:30:18.894 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:30:18.915 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:30:19.000 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-01T12:30:19.000 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T12:30:19.014 INFO:teuthology.orchestra.console.smithi007:Power off 2023-10-01T12:30:19.014 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T12:30:19.024 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-01T12:30:19.024 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:19.039 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-10-01T12:30:19.063 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:19.071 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-01T12:30:19.088 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-01T12:30:23.074 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:23.104 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:23.206 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-01T12:30:23.212 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-01T12:30:27.211 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:27.225 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:27.320 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-01T12:30:27.336 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-01T12:30:27.455 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-10-01T12:30:27.556 INFO:teuthology.orchestra.console.smithi007:Power on 2023-10-01T12:30:27.565 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T12:30:27.588 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2023-10-01T12:30:27.611 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:27.635 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-01T12:30:31.324 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:31.431 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-01T12:30:31.532 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-01T12:30:31.633 INFO:teuthology.orchestra.console.smithi033:Power on 2023-10-01T12:30:31.633 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T12:30:31.654 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-10-01T12:30:31.654 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:31.662 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:31.679 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-01T12:30:31.771 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-01T12:30:35.682 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:35.772 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T12:30:35.845 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-01T12:30:35.945 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-01T12:30:36.171 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-10-01T12:30:36.272 INFO:teuthology.orchestra.console.smithi007:Power on completed 2023-10-01T12:30:36.272 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-10-01T12:30:36.272 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:30:36.373 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2023-10-01T12:30:36.498 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:30:51.342 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:30:51.558 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:31:06.426 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:31:06.627 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:31:21.514 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:31:21.686 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:31:36.590 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:31:36.742 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:31:51.734 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:31:51.859 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:32:06.822 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:32:06.917 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:32:21.898 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:32:21.976 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:32:36.982 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:32:37.041 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:32:52.065 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-01T12:32:52.095 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:32:52.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:32:52.631 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: Authentication failed. 2023-10-01T12:32:52.631 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T12:32:52.632 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T12:32:52.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-01T12:32:53.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-01T12:32:54.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-01T12:33:07.166 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-01T12:33:07.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:33:10.298 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-01T12:33:16.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:33:19.354 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-01T12:33:25.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:33:28.410 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-01T12:33:34.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:33:37.470 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-01T12:33:43.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:33:46.654 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-01T12:33:52.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:34:52.658 WARNING:teuthology.provision.fog.smithi007:timed out 2023-10-01T12:34:58.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:34:58.872 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T12:34:58.872 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T12:34:59.209 INFO:teuthology.provision.fog.smithi007:Node is ready 2023-10-01T12:34:59.209 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2023-10-01T12:34:59.224 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2023-10-01T12:34:59.224 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2023-10-01T12:34:59.280 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2023-10-01T12:34:59.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-10-01T12:34:59.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2023-10-01T12:34:59.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2023-10-01T12:34:59.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2023-10-01T12:34:59.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-10-01T12:34:59.634 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-10-01T12:34:59.690 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2023-10-01T12:34:59.691 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-01T12:34:59.691 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2023-10-01T12:34:59.691 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T12:34:59.691 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-01T12:34:59.691 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T12:34:59.692 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2023-10-01T12:34:59.692 DEBUG:teuthology.parallel:result is None 2023-10-01T12:35:07.007 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-01T12:35:07.007 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi033 2023-10-01T12:35:16.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-01T12:35:16.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:35:16.291 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-01T12:35:16.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-01T12:35:16.647 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T12:35:16.648 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T12:35:16.662 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-10-01T12:35:16.663 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-10-01T12:35:16.719 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-10-01T12:35:16.720 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-10-01T12:35:16.776 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-10-01T12:35:16.776 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-01T12:35:16.883 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-10-01T12:35:16.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-10-01T12:35:16.988 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-10-01T12:35:17.060 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-01T12:35:17.132 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-01T12:35:17.188 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-10-01T12:35:17.188 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-10-01T12:35:17.188 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-10-01T12:35:17.189 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-10-01T12:35:17.189 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-10-01T12:35:17.189 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-10-01T12:35:17.189 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-01T12:35:17.189 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-01T12:35:17.189 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-10-01T12:35:17.189 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-01T12:35:17.190 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-10-01T12:35:17.190 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T12:35:17.190 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-01T12:35:17.190 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T12:35:17.190 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-10-01T12:35:17.191 DEBUG:teuthology.parallel:result is None 2023-10-01T12:35:17.364 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2023-10-01T12:35:17.365 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T12:35:17.388 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-10-01T12:35:17.388 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T12:35:17.406 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2023-10-01T12:35:17.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-01T12:35:17.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:35:17.507 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-10-01T12:35:17.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-01T12:35:17.583 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-10-01T12:35:17.640 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-10-01T12:35:17.640 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2023-10-01T12:35:17.697 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-01T12:35:17.698 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2023-10-01T12:35:17.698 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T12:35:17.698 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-01T12:35:17.698 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T12:35:17.698 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-10-01T12:35:17.722 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-10-01T12:35:17.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-01T12:35:17.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T12:35:17.818 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-01T12:35:17.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-01T12:35:17.888 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-10-01T12:35:17.943 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-10-01T12:35:17.943 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-01T12:35:17.998 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-10-01T12:35:17.998 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-10-01T12:35:17.998 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-10-01T12:35:17.998 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-10-01T12:35:17.998 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-10-01T12:35:17.998 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-10-01T12:35:17.998 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-01T12:35:17.999 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-01T12:35:17.999 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-10-01T12:35:17.999 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-01T12:35:17.999 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-10-01T12:35:17.999 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T12:35:17.999 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-01T12:35:17.999 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T12:35:18.000 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-01T12:35:18.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:35:18.110 INFO:teuthology.dispatcher.supervisor:Running job 7403174 2023-10-01T12:35:18.110 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-09-27_16:09:20-rados-wip-lflores-testing-2023-09-26-1857-distro-default-smithi/7403174 --name lflores-2023-09-27_16:09:20-rados-wip-lflores-testing-2023-09-26-1857-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/lflores-2023-09-27_16:09:20-rados-wip-lflores-testing-2023-09-26-1857-distro-default-smithi/7403174/orig.config.yaml 2023-10-01T12:35:18.113 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-09-27_16:09:20-rados-wip-lflores-testing-2023-09-26-1857-distro-default-smithi/7403174 2023-10-01T12:35:18.113 INFO:teuthology.dispatcher.supervisor:Job PID: 3273344 2023-10-01T12:35:18.113 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-01T12:37:18.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:39:18.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:41:18.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:43:18.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:45:19.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:47:19.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:49:19.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:51:19.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:53:19.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:55:19.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:57:20.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T12:59:20.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:01:20.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:03:20.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:05:20.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:07:20.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:09:21.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:11:21.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:13:21.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:15:21.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:17:21.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:19:21.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:21:22.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:23:22.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T13:23:22.246 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-01T13:23:22.418 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-01T13:23:22.419 INFO:teuthology.nuke:Checking targets against current locks 2023-10-01T13:23:22.474 DEBUG:teuthology.nuke:shortname: smithi007 2023-10-01T13:23:22.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T13:23:22.495 DEBUG:teuthology.nuke:shortname: smithi033 2023-10-01T13:23:22.496 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T13:23:22.499 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-09-27_16:09:20-rados-wip-lflores-testing-2023-09-26-1857-distro-default-smithi/7403174', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 12:30:16.888909', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkwHf/Qx0IfRy2rgbFOI0rv5c9gk3fbMg9+fvv7QYw7rhvr+xitEqfGFOvJsaXbaxAO5cesAZ0TerFaVenCJi0='} 2023-10-01T13:23:22.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-09-27_16:09:20-rados-wip-lflores-testing-2023-09-26-1857-distro-default-smithi/7403174', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 12:30:16.890914', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEaT7B1oRfGiW6ihkXJfVEdlD0advEy3z2NEk4JpTKiRQO07f+aoadJ/rnb6mEz4pDJthKdLakOBiDSknZS/2AQ='} 2023-10-01T13:23:22.552 INFO:teuthology.orchestra.console.smithi007:Power off 2023-10-01T13:23:22.553 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T13:23:22.575 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-10-01T13:23:22.575 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T13:23:22.589 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-01T13:23:22.589 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T13:23:22.596 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-01T13:23:22.610 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-01T13:23:22.610 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T13:23:22.631 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-01T13:23:22.698 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-10-01T13:23:22.732 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-01T13:23:22.847 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2023-10-01T13:23:22.880 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com