2023-08-31T18:49:37.963 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T18:49:37.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T18:49:38.109 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f035aa92670>, signals=[15]) 2023-08-31T18:49:38.110 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-08-31T18:49:38.111 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T18:49:38.111 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-08-31T18:49:38.128 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-08-31T18:49:38.129 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T18:49:38.129 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-08-31T18:49:38.131 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-08-31T18:49:38.154 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-08-31T18:49:38.204 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-31T18:49:38.232 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-31T18:49:38.244 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_9.stream (ID 10) 2023-08-31T18:49:38.244 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 10} 2023-08-31T18:49:38.275 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10) 2023-08-31T18:49:38.276 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 10} 2023-08-31T18:49:38.304 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 9.stream 2023-08-31T18:49:38.305 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:49:38.324 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream 2023-08-31T18:49:38.324 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:49:38.359 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T18:49:38.370 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T18:49:38.400 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-08-31T18:49:38.405 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-08-31T18:49:38.489 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:49:38.493 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:49:38.578 INFO:teuthology.orchestra.console.smithi139:Power off 2023-08-31T18:49:38.579 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T18:49:38.591 INFO:teuthology.orchestra.console.smithi167:Power off 2023-08-31T18:49:38.592 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T18:49:38.599 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-08-31T18:49:38.599 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:38.612 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-08-31T18:49:38.612 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:38.620 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-08-31T18:49:38.635 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-31T18:49:42.622 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:42.637 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:42.732 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-08-31T18:49:42.746 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-31T18:49:46.738 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:46.747 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:46.847 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-08-31T18:49:46.856 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-31T18:49:50.850 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:50.857 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:50.959 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-08-31T18:49:50.966 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-31T18:49:51.062 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-08-31T18:49:51.068 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-08-31T18:49:51.163 INFO:teuthology.orchestra.console.smithi139:Power on 2023-08-31T18:49:51.163 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T18:49:51.171 INFO:teuthology.orchestra.console.smithi167:Power on 2023-08-31T18:49:51.172 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T18:49:51.185 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-08-31T18:49:51.186 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:51.198 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-08-31T18:49:51.199 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:51.211 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-08-31T18:49:51.222 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-31T18:49:55.214 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:55.224 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:55.323 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-08-31T18:49:55.334 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-31T18:49:55.425 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-08-31T18:49:55.526 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-08-31T18:49:55.527 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:49:59.338 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:49:59.549 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-31T18:49:59.650 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-08-31T18:49:59.751 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-08-31T18:49:59.752 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:50:10.590 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:50:14.823 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:50:25.662 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:50:29.891 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:50:40.739 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:50:44.958 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:50:55.818 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:51:00.034 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:51:10.898 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:51:15.103 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:51:25.974 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:51:30.166 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:51:41.050 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:51:45.242 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:51:56.126 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:52:00.294 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:52:11.197 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:52:15.354 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:52:26.274 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-08-31T18:52:26.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:52:29.406 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:52:30.428 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:52:35.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:52:38.494 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:52:44.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:52:45.497 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-31T18:52:45.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:52:47.582 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:52:48.637 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:52:53.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:52:54.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:52:56.666 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:52:57.694 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:53:02.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:03.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:05.726 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:53:06.778 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:53:11.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:12.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:14.810 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:53:15.834 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:53:20.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:21.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:23.866 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:53:24.922 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:53:29.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:30.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:33.978 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:53:39.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:43.034 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:53:48.314 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:53:49.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:52.090 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-31T18:53:54.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:53:57.370 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-08-31T18:53:58.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:54:03.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:54:03.618 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T18:54:03.619 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T18:54:29.287 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-08-31T18:54:29.287 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-08-31T18:54:29.306 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-08-31T18:54:29.306 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-08-31T18:54:29.364 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-08-31T18:54:29.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-08-31T18:54:29.488 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-08-31T18:54:29.519 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-08-31T18:54:29.589 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-08-31T18:54:29.657 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-08-31T18:54:29.725 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-08-31T18:54:29.780 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-08-31T18:54:29.780 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2023-08-31T18:54:29.780 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-08-31T18:54:29.781 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-08-31T18:54:29.781 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2023-08-31T18:54:29.781 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2023-08-31T18:54:29.781 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T18:54:29.781 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-08-31T18:54:29.782 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2023-08-31T18:54:29.782 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T18:54:29.782 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-08-31T18:54:29.782 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T18:54:29.782 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T18:54:29.783 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T18:54:29.784 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-08-31T18:54:29.785 DEBUG:teuthology.parallel:result is None 2023-08-31T18:54:58.095 WARNING:teuthology.provision.fog.smithi167:timed out 2023-08-31T18:55:04.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:55:04.341 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T18:55:04.342 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T18:55:04.673 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-08-31T18:55:04.674 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-08-31T18:55:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-08-31T18:55:04.688 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-08-31T18:55:04.743 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-08-31T18:55:04.743 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-08-31T18:55:04.850 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-08-31T18:55:04.878 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-08-31T18:55:04.945 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-08-31T18:55:05.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-08-31T18:55:05.080 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-08-31T18:55:05.134 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-08-31T18:55:05.135 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-08-31T18:55:05.135 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-08-31T18:55:05.135 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-08-31T18:55:05.135 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-08-31T18:55:05.136 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-08-31T18:55:05.136 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T18:55:05.136 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-08-31T18:55:05.137 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-08-31T18:55:05.137 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T18:55:05.137 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-08-31T18:55:05.137 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T18:55:05.137 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T18:55:05.138 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T18:55:05.138 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-08-31T18:55:05.139 DEBUG:teuthology.parallel:result is None 2023-08-31T18:55:05.295 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-08-31T18:55:05.296 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T18:55:05.325 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-08-31T18:55:05.325 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T18:55:05.351 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-08-31T18:55:05.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-08-31T18:55:05.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:55:05.437 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-08-31T18:55:05.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-08-31T18:55:05.505 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-08-31T18:55:05.560 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-08-31T18:55:05.561 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-08-31T18:55:05.615 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-08-31T18:55:05.615 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2023-08-31T18:55:05.616 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-08-31T18:55:05.616 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-08-31T18:55:05.616 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2023-08-31T18:55:05.616 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2023-08-31T18:55:05.616 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T18:55:05.617 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-08-31T18:55:05.617 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2023-08-31T18:55:05.617 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T18:55:05.617 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-08-31T18:55:05.618 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T18:55:05.618 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T18:55:05.618 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T18:55:05.619 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-08-31T18:55:05.642 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-08-31T18:55:05.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-08-31T18:55:05.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:55:05.725 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-08-31T18:55:05.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-08-31T18:55:05.792 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-08-31T18:55:05.846 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-08-31T18:55:05.847 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-08-31T18:55:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-08-31T18:55:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-08-31T18:55:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-08-31T18:55:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-08-31T18:55:05.902 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-08-31T18:55:05.902 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-08-31T18:55:05.902 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T18:55:05.902 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-08-31T18:55:05.903 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-08-31T18:55:05.903 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T18:55:05.903 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-08-31T18:55:05.903 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T18:55:05.904 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T18:55:05.904 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T18:55:05.904 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-08-31T18:55:06.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T18:55:06.134 INFO:teuthology.dispatcher.supervisor:Running job 7385785 2023-08-31T18:55:06.134 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385785 --name pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} -- /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385785/orig.config.yaml 2023-08-31T18:55:06.138 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385785 2023-08-31T18:55:06.139 INFO:teuthology.dispatcher.supervisor:Job PID: 2158028 2023-08-31T18:55:06.139 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-31T18:57:06.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T18:57:06.306 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-31T18:57:06.419 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-31T18:57:06.420 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T18:57:06.472 DEBUG:teuthology.nuke:shortname: smithi139 2023-08-31T18:57:06.472 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T18:57:06.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385785', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 18:49:37.128532', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8w+x10mjPorod4LbBl4Na17t8d9ZOa+TTuw8vGf+5CRAWNMfrjzGPDj1khTfvHOUI5/PmORBr3Bcz22HiPMU8='} 2023-08-31T18:57:06.496 DEBUG:teuthology.nuke:shortname: smithi167 2023-08-31T18:57:06.496 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T18:57:06.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385785', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 18:49:37.126612', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPWBTu3wlaNpwwzl1PIztW9nKF+uxc6DTvnoBkrH0NVl/ZDgOyexkrZR4lj9vedwctzP4LzxFbQ0iFK7CIM//Nw='} 2023-08-31T18:57:06.562 INFO:teuthology.orchestra.console.smithi139:Power off 2023-08-31T18:57:06.563 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T18:57:06.592 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-08-31T18:57:06.592 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:57:06.606 INFO:teuthology.orchestra.console.smithi167:Power off 2023-08-31T18:57:06.607 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T18:57:06.618 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-08-31T18:57:06.633 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-08-31T18:57:06.634 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T18:57:06.656 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-31T18:57:06.719 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-08-31T18:57:06.758 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-08-31T18:57:06.872 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com 2023-08-31T18:57:06.906 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com