2023-10-14T09:14:51.507 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T09:14:51.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:14:51.652 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f484e8f8ca0>, signals=[15]) 2023-10-14T09:14:51.653 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-10-14T09:14:51.654 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T09:14:51.654 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-10-14T09:14:51.674 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-10-14T09:14:51.675 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T09:14:51.675 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-10-14T09:14:51.676 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-10-14T09:14:51.699 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-10-14T09:14:51.757 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-14T09:14:51.761 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-14T09:14:51.801 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10) 2023-10-14T09:14:51.802 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 10} 2023-10-14T09:14:51.807 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2023-10-14T09:14:51.807 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 10} 2023-10-14T09:14:51.848 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream 2023-10-14T09:14:51.848 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:14:51.851 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2023-10-14T09:14:51.852 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:14:51.925 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T09:14:51.929 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T09:14:51.963 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-10-14T09:14:51.983 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-10-14T09:14:52.021 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:14:52.031 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:14:52.152 INFO:teuthology.orchestra.console.smithi102:Power off 2023-10-14T09:14:52.153 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:14:52.165 INFO:teuthology.orchestra.console.smithi129:Power off 2023-10-14T09:14:52.166 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:14:52.174 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-10-14T09:14:52.174 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:14:52.187 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-10-14T09:14:52.187 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:14:52.197 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-14T09:14:52.211 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-14T09:14:52.299 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-10-14T09:14:52.399 INFO:teuthology.orchestra.console.smithi102:Power on 2023-10-14T09:14:52.400 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T09:14:52.420 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-10-14T09:14:52.421 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:14:52.443 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-14T09:14:56.214 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:14:56.324 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-14T09:14:56.445 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:14:56.554 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-14T09:15:00.326 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:15:00.435 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-14T09:15:00.536 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-10-14T09:15:00.556 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:15:00.638 INFO:teuthology.orchestra.console.smithi129:Power on 2023-10-14T09:15:00.639 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T09:15:00.659 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-10-14T09:15:00.660 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:15:00.668 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-10-14T09:15:00.681 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-14T09:15:00.770 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-10-14T09:15:00.870 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-10-14T09:15:00.871 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:15:04.686 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:15:04.796 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-14T09:15:08.799 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:15:08.909 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-14T09:15:09.010 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-10-14T09:15:09.111 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-10-14T09:15:09.112 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:15:15.954 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:15:24.206 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:15:31.038 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:15:39.308 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:15:46.110 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:15:54.388 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:16:01.189 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:16:09.485 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:16:16.258 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:16:24.566 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:16:31.343 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:16:39.652 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:16:46.410 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:16:54.718 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:17:01.481 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:17:09.794 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:17:16.550 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:17:24.862 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:17:31.622 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-14T09:17:31.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:17:39.942 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:17:50.078 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:17:55.011 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-14T09:17:55.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:17:56.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:17:59.162 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:18:05.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:18:08.218 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:18:13.626 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-14T09:18:14.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:18:17.274 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:18:19.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:18:22.682 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-14T09:18:23.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:18:26.330 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:18:28.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:18:31.739 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-14T09:18:32.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:18:38.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:18:41.402 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-14T09:18:47.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:19:04.061 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T09:19:04.062 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T09:19:29.432 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-10-14T09:19:29.433 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-10-14T09:19:29.491 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-10-14T09:19:29.492 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-10-14T09:19:29.548 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-10-14T09:19:29.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-10-14T09:19:29.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-10-14T09:19:29.716 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-10-14T09:19:29.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-10-14T09:19:29.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-10-14T09:19:29.927 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-10-14T09:19:29.983 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-10-14T09:19:29.984 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2023-10-14T09:19:29.984 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-10-14T09:19:29.984 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-10-14T09:19:29.984 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2023-10-14T09:19:29.984 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2023-10-14T09:19:29.985 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T09:19:29.985 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-10-14T09:19:29.985 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2023-10-14T09:19:29.985 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T09:19:29.986 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-10-14T09:19:29.986 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T09:19:29.986 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T09:19:29.986 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T09:19:29.987 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-10-14T09:19:29.992 DEBUG:teuthology.parallel:result is None 2023-10-14T09:19:47.410 WARNING:teuthology.provision.fog.smithi129:timed out 2023-10-14T09:19:53.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:19:53.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T09:19:53.661 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T09:19:53.972 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-10-14T09:19:53.973 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-10-14T09:19:53.987 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-10-14T09:19:53.988 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-10-14T09:19:54.043 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-10-14T09:19:54.044 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-10-14T09:19:54.167 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-10-14T09:19:54.195 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-10-14T09:19:54.262 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-10-14T09:19:54.330 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-10-14T09:19:54.397 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-10-14T09:19:54.452 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-10-14T09:19:54.452 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-10-14T09:19:54.452 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-10-14T09:19:54.453 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-10-14T09:19:54.453 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-10-14T09:19:54.453 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-10-14T09:19:54.453 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T09:19:54.453 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-10-14T09:19:54.454 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-10-14T09:19:54.454 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T09:19:54.454 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-10-14T09:19:54.454 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T09:19:54.454 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T09:19:54.455 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T09:19:54.455 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-10-14T09:19:54.456 DEBUG:teuthology.parallel:result is None 2023-10-14T09:19:54.740 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-10-14T09:19:54.741 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-14T09:19:54.772 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-10-14T09:19:54.772 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-14T09:19:54.798 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-10-14T09:19:54.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:19:54.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:19:54.932 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-10-14T09:19:55.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:19:55.106 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-10-14T09:19:55.161 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-10-14T09:19:55.162 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-10-14T09:19:55.216 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-10-14T09:19:55.217 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2023-10-14T09:19:55.217 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-10-14T09:19:55.217 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-10-14T09:19:55.218 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2023-10-14T09:19:55.218 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2023-10-14T09:19:55.218 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T09:19:55.218 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-10-14T09:19:55.218 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2023-10-14T09:19:55.219 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T09:19:55.219 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-10-14T09:19:55.219 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T09:19:55.219 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T09:19:55.220 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T09:19:55.220 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-10-14T09:19:55.238 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-10-14T09:19:55.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:19:55.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:19:55.361 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-10-14T09:19:55.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:19:55.434 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-10-14T09:19:55.488 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-10-14T09:19:55.489 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-10-14T09:19:55.543 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-10-14T09:19:55.543 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-10-14T09:19:55.544 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-10-14T09:19:55.544 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-10-14T09:19:55.544 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-10-14T09:19:55.544 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-10-14T09:19:55.545 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T09:19:55.545 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-10-14T09:19:55.545 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-10-14T09:19:55.545 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T09:19:55.545 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-10-14T09:19:55.546 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T09:19:55.546 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T09:19:55.546 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T09:19:55.547 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-10-14T09:19:55.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:19:55.672 INFO:teuthology.dispatcher.supervisor:Running job 7425164 2023-10-14T09:19:55.672 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164 --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/orig.config.yaml 2023-10-14T09:19:55.676 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164 2023-10-14T09:19:55.676 INFO:teuthology.dispatcher.supervisor:Job PID: 1968338 2023-10-14T09:19:55.677 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-14T09:21:55.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:23:55.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:25:56.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:27:56.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:29:56.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:31:56.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:33:56.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:35:56.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:37:57.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:39:57.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:41:57.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:41:57.551 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-14T09:41:57.711 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-14T09:41:57.712 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T09:41:57.760 DEBUG:teuthology.nuke:shortname: smithi102 2023-10-14T09:41:57.761 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:41:57.785 DEBUG:teuthology.nuke:shortname: smithi129 2023-10-14T09:41:57.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:41:57.789 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 09:14:50.692757', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwh5NEmomLdH1twgM0mFjSdTELICqTtUwIwr5b+COO+24s2altP7MGFi3jSA2PfHs9EFjfsxWBbDbY2MHU1oe4='} 2023-10-14T09:41:57.811 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 09:14:50.694687', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCjJDbPyB/hulx2E9LwE3smeu/3pBngA8xVUoG2ZWnTy2bz9+39RnLbFTKciGkGMs/h7kdN6UjCdyI4AEIG0oMo='} 2023-10-14T09:41:57.843 INFO:teuthology.orchestra.console.smithi102:Power off 2023-10-14T09:41:57.844 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:41:57.870 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-10-14T09:41:57.871 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:41:57.893 INFO:teuthology.orchestra.console.smithi129:Power off 2023-10-14T09:41:57.893 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:41:57.902 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-14T09:41:57.915 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-10-14T09:41:57.915 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:41:57.935 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-14T09:41:58.004 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-10-14T09:41:58.036 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-10-14T09:41:58.158 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-10-14T09:41:58.184 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com