2023-08-30T22:48:51.998 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T22:48:52.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:48:52.142 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0b9a046670>, signals=[15]) 2023-08-30T22:48:52.143 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-08-30T22:48:52.144 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:48:52.144 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-08-30T22:48:52.166 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-08-30T22:48:52.167 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:48:52.167 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-08-30T22:48:52.169 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-08-30T22:48:52.190 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-08-30T22:48:52.259 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T22:48:52.263 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T22:48:52.304 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T22:48:52.304 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3} 2023-08-30T22:48:52.310 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T22:48:52.311 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 3} 2023-08-30T22:48:52.352 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream 2023-08-30T22:48:52.352 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:48:52.356 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 8.stream 2023-08-30T22:48:52.356 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:48:52.443 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:48:52.450 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:48:52.480 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-08-30T22:48:52.489 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-08-30T22:48:52.533 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:48:52.550 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:48:52.671 INFO:teuthology.orchestra.console.smithi062:Power off 2023-08-30T22:48:52.672 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:48:52.686 INFO:teuthology.orchestra.console.smithi059:Power off 2023-08-30T22:48:52.686 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:48:52.696 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-08-30T22:48:52.697 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:52.709 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-08-30T22:48:52.709 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:52.719 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T22:48:52.730 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-30T22:48:52.821 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-08-30T22:48:52.832 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-08-30T22:48:52.922 INFO:teuthology.orchestra.console.smithi062:Power on 2023-08-30T22:48:52.923 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:48:52.933 INFO:teuthology.orchestra.console.smithi059:Power on 2023-08-30T22:48:52.934 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:48:52.947 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-08-30T22:48:52.948 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:52.956 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-08-30T22:48:52.957 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:52.969 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T22:48:52.976 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-30T22:48:56.974 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:56.981 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:57.084 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T22:48:57.090 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-08-30T22:48:57.190 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-08-30T22:48:57.291 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-08-30T22:48:57.292 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:49:01.086 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:49:01.194 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-30T22:49:01.295 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-08-30T22:49:01.396 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-08-30T22:49:01.397 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:49:12.376 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:49:16.484 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:49:27.488 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:49:31.598 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:49:42.618 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:49:46.693 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:49:57.738 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:50:01.810 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:50:12.862 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:50:16.910 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:50:27.984 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:50:32.038 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:50:43.110 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:50:47.170 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:50:58.262 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:51:02.318 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:51:13.406 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:51:17.442 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:51:28.518 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T22:51:28.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:28.740 ERROR:teuthology.orchestra.connection:Error authenticating with smithi059.front.sepia.ceph.com: Authentication failed. 2023-08-30T22:51:28.742 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:51:28.743 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:51:28.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-30T22:51:29.750 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-30T22:51:32.540 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T22:51:32.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:35.706 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:51:41.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:44.766 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:51:50.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:53.822 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:51:59.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:02.874 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:52:08.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:11.930 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:52:17.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:20.986 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:52:26.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:30.046 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:52:36.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:46.362 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:52:52.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:55.422 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T22:53:01.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:03.241 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:53:03.242 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:53:20.666 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-30T22:53:20.756 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi059 2023-08-30T22:53:29.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-30T22:53:29.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:29.977 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-08-30T22:53:29.977 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-08-30T22:53:29.993 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-08-30T22:53:30.000 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-08-30T22:53:30.001 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-08-30T22:53:30.062 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-08-30T22:53:30.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-08-30T22:53:30.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-08-30T22:53:30.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-08-30T22:53:30.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-30T22:53:30.263 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:53:30.264 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:53:30.285 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-08-30T22:53:30.285 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-08-30T22:53:30.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-08-30T22:53:30.345 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-08-30T22:53:30.345 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-08-30T22:53:30.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-08-30T22:53:30.405 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-08-30T22:53:30.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-08-30T22:53:30.423 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-08-30T22:53:30.483 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-08-30T22:53:30.483 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-08-30T22:53:30.483 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-08-30T22:53:30.484 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:30.484 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-08-30T22:53:30.484 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:30.484 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:30.484 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:30.485 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:30.485 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:30.485 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:30.485 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:30.485 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:30.486 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-08-30T22:53:30.487 DEBUG:teuthology.parallel:result is None 2023-08-30T22:53:30.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-08-30T22:53:30.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-08-30T22:53:30.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-08-30T22:53:30.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-08-30T22:53:30.759 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-08-30T22:53:30.820 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-08-30T22:53:30.821 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8" 2023-08-30T22:53:30.821 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-08-30T22:53:30.821 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:30.822 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8" 2023-08-30T22:53:30.822 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:30.823 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:30.823 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:30.823 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:30.824 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:30.824 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:30.824 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:30.825 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:30.825 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-08-30T22:53:30.826 DEBUG:teuthology.parallel:result is None 2023-08-30T22:53:30.988 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-08-30T22:53:30.988 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:53:31.013 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-08-30T22:53:31.013 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:53:31.031 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:53:31.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-30T22:53:31.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:31.139 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-08-30T22:53:31.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-30T22:53:31.212 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-08-30T22:53:31.272 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-08-30T22:53:31.272 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-08-30T22:53:31.331 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-08-30T22:53:31.331 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8" 2023-08-30T22:53:31.332 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-08-30T22:53:31.332 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:31.332 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8" 2023-08-30T22:53:31.332 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:31.332 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:31.332 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:31.333 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:31.333 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:31.333 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:31.333 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:31.333 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:31.334 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-08-30T22:53:31.354 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:53:31.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-08-30T22:53:31.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:31.428 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-08-30T22:53:31.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-08-30T22:53:31.500 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-08-30T22:53:31.561 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-08-30T22:53:31.562 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-08-30T22:53:31.622 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-08-30T22:53:31.622 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-08-30T22:53:31.622 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-08-30T22:53:31.622 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:31.623 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-08-30T22:53:31.623 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:31.623 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:31.623 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:31.623 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:31.624 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:31.624 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:31.624 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:31.624 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:31.625 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-08-30T22:53:31.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:53:31.756 INFO:teuthology.dispatcher.supervisor:Running job 7384815 2023-08-30T22:53:31.756 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384815 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384815/orig.config.yaml 2023-08-30T22:53:31.759 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384815 2023-08-30T22:53:31.760 INFO:teuthology.dispatcher.supervisor:Job PID: 3115650 2023-08-30T22:53:31.760 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T22:55:31.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:57:32.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:59:32.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:01:32.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:03:32.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:05:32.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:07:32.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:09:33.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:09:33.147 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T23:09:33.265 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T23:09:33.266 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T23:09:33.312 DEBUG:teuthology.nuke:shortname: smithi059 2023-08-30T23:09:33.312 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:09:33.334 DEBUG:teuthology.nuke:shortname: smithi062 2023-08-30T23:09:33.334 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:09:33.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384815', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:48:51.189951', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdjyIfqz13jXbKEMvP+uwc5DB5hy/47S6dwDfzx4T0qq7Rk0jIk5Yb8U3Kk4vNdPdgNG2h/A8BGwxgtpGx7puw='} 2023-08-30T23:09:33.360 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384815', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:48:51.188013', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9nlfdWAQ9Dk5zk8R404I9N0IN7I0XghepxOGFESH8qIrMdscBlgDk/hzH0r5qHIGvs+JYmPgt3W1tC2CfHNGLIgiULlvz5z5LhtQRQwYWnwBLUcK8j7PrdfsFsHwiLrUazAHjYICzhnmDyyY38EgC5TYAFfLCXLRRAH9LWcXuVSG9m0kz+CsDmMHyPkeFtNdEEiVmkx3ewfkC8eUUZBohzEdlj3LymWbRIlMIH0v2M9G73jjQpvvoWfTie/kJhY25gmc1qvATQpqFIc9KmmFA3HyLan7A/c+ecrf4uKIswS+lTUsGkBabWajnDSd07ZD7d6Ft1G3RdRJfLMMdiFA6Bei7bdx2yo7horIuha5R9sy4oklkXVkmBHHQW4boVulpIy0ay1KOrswz5LnmtkPAco+3B/FXqMu0vkuhRxYeCwv25NJ2Au4sRuRAYo+KVEFo4IyOVF8YZRm+CSeAPeFz0ESyeStq76BRttbejpfuaOTTar3j49C0MF0bsdS7T4s='} 2023-08-30T23:09:33.386 INFO:teuthology.orchestra.console.smithi059:Power off 2023-08-30T23:09:33.387 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:09:33.408 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-08-30T23:09:33.409 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:09:33.428 INFO:teuthology.orchestra.console.smithi062:Power off 2023-08-30T23:09:33.429 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:09:33.437 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-30T23:09:33.450 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-08-30T23:09:33.450 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:09:33.472 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T23:09:33.539 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-08-30T23:09:33.574 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-08-30T23:09:33.694 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-08-30T23:09:33.720 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com