2023-11-04T01:50:58.953 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:50:58.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:50:59.099 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f51589a7ca0>, signals=[15]) 2023-11-04T01:50:59.100 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-11-04T01:50:59.100 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T01:50:59.101 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-11-04T01:50:59.120 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-11-04T01:50:59.121 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T01:50:59.121 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-11-04T01:50:59.122 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-11-04T01:50:59.145 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-11-04T01:50:59.187 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-04T01:50:59.221 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-04T01:50:59.226 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10) 2023-11-04T01:50:59.226 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 10} 2023-11-04T01:50:59.269 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_9.stream (ID 10) 2023-11-04T01:50:59.269 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 10} 2023-11-04T01:50:59.272 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream 2023-11-04T01:50:59.272 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:50:59.325 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 9.stream 2023-11-04T01:50:59.325 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:50:59.371 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T01:50:59.409 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-11-04T01:50:59.412 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T01:50:59.446 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-11-04T01:50:59.484 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:50:59.500 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:50:59.602 INFO:teuthology.orchestra.console.smithi181:Power off 2023-11-04T01:50:59.603 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:50:59.614 INFO:teuthology.orchestra.console.smithi097:Power off 2023-11-04T01:50:59.615 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:50:59.623 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-11-04T01:50:59.624 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:50:59.635 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-11-04T01:50:59.636 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:50:59.643 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-11-04T01:50:59.656 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-04T01:51:03.646 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:03.657 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:03.756 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-11-04T01:51:03.766 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-04T01:51:07.758 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:07.767 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:07.868 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-11-04T01:51:07.876 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-04T01:51:07.969 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-11-04T01:51:08.070 INFO:teuthology.orchestra.console.smithi181:Power on 2023-11-04T01:51:08.070 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T01:51:08.093 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-11-04T01:51:08.093 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:08.113 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-11-04T01:51:11.878 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:11.986 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-04T01:51:12.087 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-11-04T01:51:12.115 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:12.189 INFO:teuthology.orchestra.console.smithi097:Power on 2023-11-04T01:51:12.189 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T01:51:12.209 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2023-11-04T01:51:12.210 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:12.223 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-11-04T01:51:12.230 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-04T01:51:16.226 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:16.233 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:16.335 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-11-04T01:51:16.343 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-04T01:51:16.436 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-11-04T01:51:16.537 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-11-04T01:51:16.538 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:51:20.346 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:51:20.454 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-04T01:51:20.555 INFO:teuthology.orchestra.console.smithi097:Power on completed 2023-11-04T01:51:20.656 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-11-04T01:51:20.657 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:51:31.642 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:51:35.762 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:51:46.748 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:51:50.870 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:52:01.834 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:52:05.955 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:52:16.922 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:52:21.036 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:52:31.985 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:52:36.108 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:52:47.057 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:52:51.178 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:53:02.130 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:53:06.252 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:53:17.226 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:53:21.366 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:53:32.362 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:53:36.469 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:53:47.490 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-11-04T01:53:47.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:53:50.650 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-04T01:53:51.565 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-04T01:53:51.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:53:54.750 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-04T01:53:56.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:53:59.706 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-04T01:54:00.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:03.838 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-04T01:54:05.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:08.762 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-04T01:54:09.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:12.922 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-04T01:54:14.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:17.822 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-04T01:54:18.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:21.978 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-04T01:54:23.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:26.906 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-04T01:54:27.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:31.038 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-04T01:54:32.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:35.962 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-04T01:54:37.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:40.122 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-04T01:54:41.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:46.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:54:49.178 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-04T01:54:55.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:55:42.014 WARNING:teuthology.provision.fog.smithi181:timed out 2023-11-04T01:55:48.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:55:48.394 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:55:48.395 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T01:55:48.709 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-11-04T01:55:48.709 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-11-04T01:55:48.724 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2023-11-04T01:55:48.725 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2023-11-04T01:55:48.779 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-11-04T01:55:48.780 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-11-04T01:55:48.909 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2023-11-04T01:55:48.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-11-04T01:55:49.007 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2023-11-04T01:55:49.075 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-11-04T01:55:49.142 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-11-04T01:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-11-04T01:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2023-11-04T01:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-11-04T01:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2023-11-04T01:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-11-04T01:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:55:49.201 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-11-04T01:55:49.203 DEBUG:teuthology.parallel:result is None 2023-11-04T01:55:55.194 WARNING:teuthology.provision.fog.smithi097:timed out 2023-11-04T01:56:01.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:56:01.422 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:56:01.422 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T01:56:01.754 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-11-04T01:56:01.754 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-11-04T01:56:01.769 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-11-04T01:56:01.769 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2023-11-04T01:56:01.824 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-11-04T01:56:01.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-11-04T01:56:01.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2023-11-04T01:56:01.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-11-04T01:56:02.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2023-11-04T01:56:02.095 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-11-04T01:56:02.163 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-11-04T01:56:02.218 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-11-04T01:56:02.219 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2023-11-04T01:56:02.219 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-11-04T01:56:02.219 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:56:02.219 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2023-11-04T01:56:02.219 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:56:02.220 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:56:02.220 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-11-04T01:56:02.220 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:56:02.220 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:56:02.220 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:56:02.221 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:56:02.221 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:56:02.221 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:56:02.221 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-11-04T01:56:02.222 DEBUG:teuthology.parallel:result is None 2023-11-04T01:56:02.383 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-11-04T01:56:02.384 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T01:56:02.406 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-11-04T01:56:02.406 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T01:56:02.432 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-11-04T01:56:02.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-04T01:56:02.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:56:02.512 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-11-04T01:56:02.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-04T01:56:02.580 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-11-04T01:56:02.634 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-11-04T01:56:02.635 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-11-04T01:56:02.688 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-11-04T01:56:02.689 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2023-11-04T01:56:02.689 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-11-04T01:56:02.689 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:56:02.689 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2023-11-04T01:56:02.689 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:56:02.690 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:56:02.690 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-11-04T01:56:02.690 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:56:02.690 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:56:02.690 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:56:02.691 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:56:02.691 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:56:02.691 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:56:02.692 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-11-04T01:56:02.714 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-11-04T01:56:02.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-04T01:56:02.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:56:02.798 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-11-04T01:56:02.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-04T01:56:02.968 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-11-04T01:56:03.022 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-11-04T01:56:03.023 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-11-04T01:56:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-11-04T01:56:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2023-11-04T01:56:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-11-04T01:56:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:56:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2023-11-04T01:56:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:56:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:56:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-11-04T01:56:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:56:03.080 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:56:03.080 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:56:03.080 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:56:03.080 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:56:03.080 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:56:03.081 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-11-04T01:56:03.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:56:03.195 INFO:teuthology.dispatcher.supervisor:Running job 7445724 2023-11-04T01:56:03.196 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-03_16:49:22-fs-rishabh-unqiue-fsnames-testing-default-smithi/7445724 --name rishabh-2023-11-03_16:49:22-fs-rishabh-unqiue-fsnames-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} -- /home/teuthworker/archive/rishabh-2023-11-03_16:49:22-fs-rishabh-unqiue-fsnames-testing-default-smithi/7445724/orig.config.yaml 2023-11-04T01:56:03.199 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-03_16:49:22-fs-rishabh-unqiue-fsnames-testing-default-smithi/7445724 2023-11-04T01:56:03.200 INFO:teuthology.dispatcher.supervisor:Job PID: 3765538 2023-11-04T01:56:03.200 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-04T01:58:03.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:00:03.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:02:03.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:04:03.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:06:03.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:08:04.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:10:04.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:12:04.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:14:04.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:16:04.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:18:04.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:20:05.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:22:05.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:24:05.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:26:05.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:28:05.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:30:05.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:32:06.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:34:06.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:34:06.399 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-04T02:34:06.513 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-04T02:34:06.513 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T02:34:06.562 DEBUG:teuthology.nuke:shortname: smithi097 2023-11-04T02:34:06.562 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T02:34:06.590 DEBUG:teuthology.nuke:shortname: smithi181 2023-11-04T02:34:06.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T02:34:06.594 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-03_16:49:22-fs-rishabh-unqiue-fsnames-testing-default-smithi/7445724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:50:58.177961', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCsx420XYJJsr7w9NS5MlfaMC2zwhaP7U+sUpzK+Wi9h5oJzcfL3EdDUZPNYoAvJR499iN2iRMGKqIzu2b0hdc='} 2023-11-04T02:34:06.613 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-03_16:49:22-fs-rishabh-unqiue-fsnames-testing-default-smithi/7445724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:50:58.179495', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5uwxC3/MTQtLoau7IDoW9mfEr3UdZH/kP7GQEQTsStU6Xq07ZoFXyxkDGPh12DIvciqxOa30es/ZN0hwanZpA='} 2023-11-04T02:34:06.646 INFO:teuthology.orchestra.console.smithi097:Power off 2023-11-04T02:34:06.646 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T02:34:06.666 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-11-04T02:34:06.667 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:34:06.682 INFO:teuthology.orchestra.console.smithi181:Power off 2023-11-04T02:34:06.683 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T02:34:06.691 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-04T02:34:06.705 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-11-04T02:34:06.705 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:34:06.725 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-11-04T02:34:06.792 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-11-04T02:34:06.827 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-11-04T02:34:06.947 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-11-04T02:34:06.980 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com