2023-11-08T07:55:32.667 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T07:55:32.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T07:55:32.816 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6dc9b62d30>, signals=[15]) 2023-11-08T07:55:32.817 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-11-08T07:55:32.817 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T07:55:32.818 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-11-08T07:55:32.844 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-11-08T07:55:32.845 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T07:55:32.845 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-11-08T07:55:32.846 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-11-08T07:55:32.869 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-11-08T07:55:32.905 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-08T07:55:32.933 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-08T07:55:32.945 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_8.stream (ID 3) 2023-11-08T07:55:32.945 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 3} 2023-11-08T07:55:32.974 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_8.stream (ID 3) 2023-11-08T07:55:32.974 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 3} 2023-11-08T07:55:32.982 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2023-11-08T07:55:32.982 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:55:33.014 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.stream 2023-11-08T07:55:33.014 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:55:33.037 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T07:55:33.068 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T07:55:33.081 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-11-08T07:55:33.105 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-11-08T07:55:33.130 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:55:33.153 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:55:33.227 INFO:teuthology.orchestra.console.smithi116:Power off 2023-11-08T07:55:33.228 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T07:55:33.244 INFO:teuthology.orchestra.console.smithi129:Power off 2023-11-08T07:55:33.245 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T07:55:33.253 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-11-08T07:55:33.254 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:33.266 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-11-08T07:55:33.267 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:33.276 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-11-08T07:55:33.291 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-08T07:55:33.378 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-11-08T07:55:33.478 INFO:teuthology.orchestra.console.smithi116:Power on 2023-11-08T07:55:33.479 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T07:55:33.501 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-11-08T07:55:33.502 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:33.523 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-11-08T07:55:37.294 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:37.405 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-08T07:55:37.525 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:37.634 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-11-08T07:55:37.735 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-11-08T07:55:37.836 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-11-08T07:55:37.836 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:55:41.410 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:41.519 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-08T07:55:45.522 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:45.632 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-08T07:55:45.733 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-11-08T07:55:45.833 INFO:teuthology.orchestra.console.smithi129:Power on 2023-11-08T07:55:45.834 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T07:55:45.856 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-11-08T07:55:45.856 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:45.878 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-08T07:55:49.882 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:49.991 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-08T07:55:52.900 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:55:53.994 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:55:54.102 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-08T07:55:54.203 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-11-08T07:55:54.304 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-11-08T07:55:54.305 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:56:07.970 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:56:09.367 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:56:23.050 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:56:24.436 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:56:38.131 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:56:39.509 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:56:53.211 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:56:54.595 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:57:08.302 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:57:09.680 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:57:23.396 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:57:24.780 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:57:38.506 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:57:39.865 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:57:53.594 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:57:54.958 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:58:08.670 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:58:10.029 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:58:23.750 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-08T07:58:23.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:58:25.106 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:58:26.878 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:58:32.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:58:35.962 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:58:40.190 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-08T07:58:40.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:58:41.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:58:43.322 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T07:58:45.018 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:58:49.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:58:51.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:58:52.378 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T07:58:54.074 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:58:58.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:00.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:01.434 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T07:59:03.130 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:59:07.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:09.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:10.490 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T07:59:12.186 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:59:16.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:18.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:19.546 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T07:59:21.246 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:59:25.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:27.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:28.602 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T07:59:34.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:37.594 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:59:43.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:46.654 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:59:52.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:59:52.958 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T07:59:55.738 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-08T07:59:58.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T08:00:01.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T08:00:01.976 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T08:00:01.977 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T08:00:02.046 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-08T08:00:08.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T08:00:09.611 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T08:00:09.612 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T08:00:22.482 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-11-08T08:00:22.483 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-11-08T08:00:22.507 INFO:teuthology.orchestra.run.smithi116.stdout:smithi193 2023-11-08T08:00:22.507 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi193 /etc/hosts 2023-11-08T08:00:22.567 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-11-08T08:00:22.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-11-08T08:00:22.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi193/smithi116/g' /etc/hosts 2023-11-08T08:00:22.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.193/172.21.15.116/g' /etc/hosts 2023-11-08T08:00:22.851 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi193/smithi116/g' /etc/hostname 2023-11-08T08:00:22.920 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-11-08T08:00:22.988 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-11-08T08:00:23.047 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-11-08T08:00:23.047 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-11-08T08:00:23.047 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-11-08T08:00:23.048 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-11-08T08:00:23.048 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-11-08T08:00:23.048 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-11-08T08:00:23.048 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T08:00:23.048 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-11-08T08:00:23.049 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T08:00:23.049 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-11-08T08:00:23.049 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T08:00:23.050 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T08:00:23.050 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T08:00:23.051 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-11-08T08:00:23.052 DEBUG:teuthology.parallel:result is None 2023-11-08T08:00:35.191 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-11-08T08:00:35.191 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-11-08T08:00:35.215 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-11-08T08:00:35.216 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-11-08T08:00:35.277 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-11-08T08:00:35.277 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-11-08T08:00:35.410 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-11-08T08:00:35.441 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-11-08T08:00:35.512 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-11-08T08:00:35.582 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-11-08T08:00:35.650 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-11-08T08:00:35.708 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-11-08T08:00:35.709 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8" 2023-11-08T08:00:35.709 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-11-08T08:00:35.709 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-11-08T08:00:35.709 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8" 2023-11-08T08:00:35.710 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-11-08T08:00:35.710 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T08:00:35.710 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-11-08T08:00:35.710 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T08:00:35.710 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-11-08T08:00:35.711 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T08:00:35.711 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T08:00:35.711 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T08:00:35.711 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-11-08T08:00:35.712 DEBUG:teuthology.parallel:result is None 2023-11-08T08:00:35.869 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-11-08T08:00:35.870 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T08:00:35.893 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-11-08T08:00:35.894 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T08:00:35.921 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-11-08T08:00:35.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-08T08:00:35.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T08:00:35.992 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-11-08T08:00:36.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-08T08:00:36.084 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-11-08T08:00:36.143 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-11-08T08:00:36.144 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-11-08T08:00:36.203 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-11-08T08:00:36.203 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-11-08T08:00:36.203 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-11-08T08:00:36.204 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-11-08T08:00:36.204 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-11-08T08:00:36.204 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-11-08T08:00:36.204 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T08:00:36.204 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-11-08T08:00:36.205 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T08:00:36.205 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-11-08T08:00:36.205 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T08:00:36.205 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T08:00:36.205 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T08:00:36.206 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-11-08T08:00:36.350 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-11-08T08:00:36.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-11-08T08:00:36.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T08:00:36.419 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-11-08T08:00:36.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-11-08T08:00:36.491 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-11-08T08:00:36.549 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-11-08T08:00:36.550 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-11-08T08:00:36.608 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-11-08T08:00:36.608 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8" 2023-11-08T08:00:36.609 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-11-08T08:00:36.609 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-11-08T08:00:36.609 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8" 2023-11-08T08:00:36.609 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-11-08T08:00:36.609 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T08:00:36.610 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-11-08T08:00:36.610 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T08:00:36.610 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-11-08T08:00:36.610 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T08:00:36.610 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T08:00:36.611 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T08:00:36.611 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-11-08T08:00:36.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:00:36.738 INFO:teuthology.dispatcher.supervisor:Running job 7451824 2023-11-08T08:00:36.739 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451824 --name neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} -- /home/teuthworker/archive/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451824/orig.config.yaml 2023-11-08T08:00:36.742 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451824 2023-11-08T08:00:36.743 INFO:teuthology.dispatcher.supervisor:Job PID: 69702 2023-11-08T08:00:36.743 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-08T08:02:36.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:04:36.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:06:37.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:08:37.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:10:37.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:12:37.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:14:37.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:16:37.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:18:38.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:20:38.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:22:38.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:24:38.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:24:38.661 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-08T08:24:38.816 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-08T08:24:38.817 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T08:24:38.869 DEBUG:teuthology.nuke:shortname: smithi116 2023-11-08T08:24:38.869 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T08:24:38.888 DEBUG:teuthology.nuke:shortname: smithi129 2023-11-08T08:24:38.889 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T08:24:38.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451824', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 07:55:31.821565', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLmWrVyaQLvu7kH/xOHecmPZs0Wv4Vnk8ebDAlklT4ioAMKeecUfXKCBKWoONiWEWSMBVYZ7doSnrlZcsf0LePE='} 2023-11-08T08:24:38.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451824', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 07:55:31.823139', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP75L6TR03Z2dV6ScTobCTEsiEwEJDOeIRunLkcy5G1avJ+xdQ9cy9Bds1buAVhxI7AAzWZJ//guXa7HXaHSMi0='} 2023-11-08T08:24:38.946 INFO:teuthology.orchestra.console.smithi116:Power off 2023-11-08T08:24:38.947 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T08:24:38.971 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-11-08T08:24:38.972 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T08:24:38.983 INFO:teuthology.orchestra.console.smithi129:Power off 2023-11-08T08:24:38.984 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T08:24:38.993 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-11-08T08:24:39.007 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-11-08T08:24:39.008 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T08:24:39.027 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-08T08:24:39.095 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-11-08T08:24:39.128 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-11-08T08:24:39.244 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-11-08T08:24:39.277 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com