2023-08-21T08:49:47.479 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-21T08:49:47.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:49:47.602 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6554aaf310>, signals=[15]) 2023-08-21T08:49:47.603 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-08-21T08:49:47.604 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T08:49:47.604 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-21T08:49:47.626 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-08-21T08:49:47.627 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T08:49:47.627 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-08-21T08:49:47.628 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-08-21T08:49:47.651 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-08-21T08:49:47.718 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-21T08:49:47.743 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-21T08:49:47.767 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_8.stream (ID 3) 2023-08-21T08:49:47.767 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 3} 2023-08-21T08:49:47.780 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_8.stream (ID 3) 2023-08-21T08:49:47.780 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 3} 2023-08-21T08:49:47.813 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.stream 2023-08-21T08:49:47.814 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:49:47.825 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 8.stream 2023-08-21T08:49:47.825 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:49:47.847 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T08:49:47.859 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T08:49:47.892 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-08-21T08:49:47.901 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-08-21T08:49:47.972 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:49:47.979 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:49:48.047 INFO:teuthology.orchestra.console.smithi143:Power off 2023-08-21T08:49:48.048 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T08:49:49.138 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-21T08:49:49.138 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T08:49:49.149 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-08-21T08:49:49.149 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:49.179 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-08-21T08:49:49.181 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-21T08:49:49.181 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:49.204 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-08-21T08:49:49.281 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-08-21T08:49:49.382 INFO:teuthology.orchestra.console.smithi143:Power on 2023-08-21T08:49:49.383 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T08:49:49.553 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-08-21T08:49:49.554 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:49.575 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-08-21T08:49:53.207 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:53.317 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-08-21T08:49:53.577 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:53.688 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-08-21T08:49:57.320 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:57.429 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-21T08:49:57.530 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-21T08:49:57.631 INFO:teuthology.orchestra.console.smithi104:Power on 2023-08-21T08:49:57.631 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T08:49:57.652 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2023-08-21T08:49:57.653 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:57.674 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-21T08:49:57.689 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:57.800 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-08-21T08:49:57.901 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-08-21T08:49:58.002 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-08-21T08:49:58.003 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:50:01.679 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:01.789 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-21T08:50:05.794 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:05.903 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-08-21T08:50:06.004 INFO:teuthology.orchestra.console.smithi104:Power on completed 2023-08-21T08:50:06.105 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-08-21T08:50:06.105 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:50:13.119 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:50:21.244 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:50:28.256 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:50:36.374 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:50:43.393 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:50:51.511 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:50:58.524 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:51:06.645 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:51:13.649 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:51:21.783 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:51:28.795 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:51:36.920 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:51:43.975 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:51:52.092 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:51:59.168 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:52:07.302 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:52:14.392 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:52:22.494 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:52:29.552 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-21T08:52:29.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:52:37.657 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:52:52.816 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T08:52:52.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:11.408 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T08:53:17.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:20.464 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T08:53:26.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:29.520 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T08:53:29.793 ERROR:teuthology.orchestra.connection:Error authenticating with smithi143.front.sepia.ceph.com: No SSH private key found! 2023-08-21T08:53:29.794 WARNING:teuthology.provision.fog.smithi143:No existing session 2023-08-21T08:53:35.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:35.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:38.576 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T08:53:44.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:54.160 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-21T08:54:00.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:03.216 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-21T08:54:09.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:09.416 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T08:54:09.417 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T08:54:29.913 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-08-21T08:54:29.913 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-08-21T08:54:29.938 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-08-21T08:54:29.938 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-08-21T08:54:29.999 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-08-21T08:54:29.999 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-08-21T08:54:30.120 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-08-21T08:54:30.151 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-08-21T08:54:30.220 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-08-21T08:54:30.289 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-08-21T08:54:30.357 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-08-21T08:54:30.416 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-08-21T08:54:30.416 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-08-21T08:54:30.416 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-08-21T08:54:30.416 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:54:30.416 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-08-21T08:54:30.416 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:54:30.417 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:54:30.417 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-08-21T08:54:30.417 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:54:30.417 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:54:30.417 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:54:30.417 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:54:30.417 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:54:30.418 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-08-21T08:54:30.419 DEBUG:teuthology.parallel:result is None 2023-08-21T08:54:44.579 WARNING:teuthology.provision.fog.smithi104:timed out 2023-08-21T08:54:46.128 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-21T08:54:50.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:50.801 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T08:54:50.802 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T08:54:51.055 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-08-21T08:54:51.055 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-08-21T08:54:51.074 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-08-21T08:54:51.074 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-08-21T08:54:51.133 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-08-21T08:54:51.134 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-21T08:54:51.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-08-21T08:54:51.277 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-08-21T08:54:51.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-08-21T08:54:51.413 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-21T08:54:51.479 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-21T08:54:51.537 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-08-21T08:54:51.537 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-08-21T08:54:51.537 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-08-21T08:54:51.538 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:54:51.538 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-08-21T08:54:51.538 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:54:51.538 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:54:51.538 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-08-21T08:54:51.538 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:54:51.538 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:54:51.539 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:54:51.539 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:54:51.539 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:54:51.539 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-08-21T08:54:51.540 DEBUG:teuthology.parallel:result is None 2023-08-21T08:54:51.675 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-08-21T08:54:51.676 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T08:54:51.700 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-08-21T08:54:51.701 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T08:54:51.718 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-08-21T08:54:51.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-21T08:54:51.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:51.782 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-08-21T08:54:51.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-21T08:54:51.850 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-08-21T08:54:51.908 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-08-21T08:54:51.909 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-21T08:54:51.966 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-08-21T08:54:51.966 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-08-21T08:54:51.966 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-08-21T08:54:51.967 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:54:51.967 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-08-21T08:54:51.967 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:54:51.967 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:54:51.967 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-08-21T08:54:51.967 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:54:51.967 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:54:51.968 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:54:51.968 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:54:51.968 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:54:51.968 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-21T08:54:51.992 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-08-21T08:54:51.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-08-21T08:54:51.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:52.061 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-08-21T08:54:52.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-08-21T08:54:52.196 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-08-21T08:54:52.254 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-08-21T08:54:52.254 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-08-21T08:54:52.313 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-08-21T08:54:52.313 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-08-21T08:54:52.313 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-08-21T08:54:52.314 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:54:52.314 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-08-21T08:54:52.314 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:54:52.314 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:54:52.314 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-08-21T08:54:52.314 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:54:52.314 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:54:52.315 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:54:52.315 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:54:52.315 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:54:52.315 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-08-21T08:54:52.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:54:52.416 INFO:teuthology.dispatcher.supervisor:Running job 7373943 2023-08-21T08:54:52.416 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373943 --name matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_8 crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373943/orig.config.yaml 2023-08-21T08:54:52.419 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373943 2023-08-21T08:54:52.420 INFO:teuthology.dispatcher.supervisor:Job PID: 8825 2023-08-21T08:54:52.420 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-21T08:56:52.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:58:52.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:00:52.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:02:52.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:04:53.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:06:53.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:08:53.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:10:53.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:12:53.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:14:53.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:16:54.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:18:54.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:20:54.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:22:54.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:24:54.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:26:55.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:28:55.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:30:55.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:32:55.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:34:55.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:34:55.617 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-21T09:34:55.695 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-21T09:34:55.696 INFO:teuthology.nuke:Checking targets against current locks 2023-08-21T09:34:55.737 DEBUG:teuthology.nuke:shortname: smithi104 2023-08-21T09:34:55.738 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T09:34:55.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 08:49:46.759058', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLXTzLA2G9rv+soy/InCfR5pzPa00bE0mUvPRW1LeRZxzgzRp/miA4JnfSOIbM18nEF8Sx8eTKw3IZMZuMpPZE='} 2023-08-21T09:34:55.763 DEBUG:teuthology.nuke:shortname: smithi143 2023-08-21T09:34:55.763 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T09:34:55.786 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 08:49:46.757115', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUb6aCFb9/C5dSk0r1LBgYjWkRDR4LK+lhecH0xBe4Z2DsjSIqWyk+HR2ym//YdM32ttI/z7NzmbV6TMCo2EWCYOE9fJ06K0olqthHy+addobUEjchg93ukdcmKnOtFB94uBw9KzUc/9rJ4JRtPFoto357U1B11yhZWTo2uzC6vJ97syBuzYot6u/gdAzitdcPAJ1P12Q1KbINehfPH3oDBL5/SbEMQdstSoJee4Q1iQIwRSlS2GF6vFRSmnx4NJa7b7JX2T5INVx4fdINCmpx9TPb6Fn7LY/JgWpivHCOFTCVqyY4sVh6INhBUJdAaooQW+QmmSV1njB8Lb8GFrU7rwFkHrh7eydeqo7fhQGBWgFGD+C2fLuDnWNFTjqt+685ULNAVxnsCS4qVz/B/AkCv1JiNjTZ1UMv4AZxK9kRAaUso3a1V3zAn8OnKv/c0kvzX45rGZJjgflnkIJVPMSVCMQzUB9KVXd0QtLz/9Dh+4MkzfYOBWQILBqvN142qEE='} 2023-08-21T09:34:55.801 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-21T09:34:55.802 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T09:34:55.823 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-21T09:34:55.824 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T09:34:55.836 INFO:teuthology.orchestra.console.smithi143:Power off 2023-08-21T09:34:55.837 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T09:34:55.846 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-21T09:34:55.857 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-08-21T09:34:55.857 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T09:34:55.875 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-08-21T09:34:55.947 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-21T09:34:55.977 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-08-21T09:34:56.093 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-08-21T09:34:56.117 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com