2023-08-16T11:20:31.445 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-16T11:20:31.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:20:31.582 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f41fc43c310>, signals=[15]) 2023-08-16T11:20:31.583 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2023-08-16T11:20:31.584 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T11:20:31.584 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-08-16T11:20:31.602 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-08-16T11:20:31.602 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T11:20:31.603 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-08-16T11:20:31.604 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"} 2023-08-16T11:20:31.627 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-08-16T11:20:31.669 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-16T11:20:31.711 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-16T11:20:31.714 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10) 2023-08-16T11:20:31.714 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 10} 2023-08-16T11:20:31.754 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10) 2023-08-16T11:20:31.755 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 10} 2023-08-16T11:20:31.759 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream 2023-08-16T11:20:31.759 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:20:31.794 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream 2023-08-16T11:20:31.794 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:20:31.823 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T11:20:31.858 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T11:20:31.861 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1} 2023-08-16T11:20:31.901 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-08-16T11:20:31.928 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:20:31.959 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:20:32.034 INFO:teuthology.orchestra.console.smithi120:Power off 2023-08-16T11:20:32.035 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:20:32.053 INFO:teuthology.orchestra.console.smithi183:Power off 2023-08-16T11:20:32.054 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:20:32.065 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2023-08-16T11:20:32.065 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:32.077 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-08-16T11:20:32.078 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:32.102 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-08-16T11:20:32.103 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-08-16T11:20:36.107 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:36.117 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:36.218 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-08-16T11:20:36.230 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-08-16T11:20:40.224 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:40.233 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:40.335 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-08-16T11:20:40.344 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-08-16T11:20:40.445 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-08-16T11:20:40.545 INFO:teuthology.orchestra.console.smithi183:Power on 2023-08-16T11:20:40.546 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T11:20:40.567 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-08-16T11:20:40.595 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:40.616 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-08-16T11:20:44.338 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:44.449 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-08-16T11:20:44.550 INFO:teuthology.orchestra.console.smithi120:Power off completed 2023-08-16T11:20:44.618 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:44.652 INFO:teuthology.orchestra.console.smithi120:Power on 2023-08-16T11:20:44.652 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T11:20:44.673 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2023-08-16T11:20:44.674 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:44.694 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-08-16T11:20:44.728 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-08-16T11:20:44.829 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-08-16T11:20:44.930 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-08-16T11:20:44.930 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:20:48.697 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:20:48.807 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-08-16T11:20:48.908 INFO:teuthology.orchestra.console.smithi120:Power on completed 2023-08-16T11:20:49.009 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2023-08-16T11:20:49.009 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:21:00.015 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:21:04.080 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:21:15.091 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:21:19.141 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:21:30.164 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:21:34.206 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:21:45.232 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:21:49.272 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:22:00.299 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:22:04.333 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:22:15.365 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:22:19.391 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:22:30.428 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:22:34.456 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:22:45.492 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:22:49.520 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:23:00.572 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:23:04.584 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:23:15.652 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:23:19.660 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-08-16T11:23:19.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:22.800 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-08-16T11:23:28.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:30.736 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-16T11:23:30.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:31.860 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-08-16T11:23:33.872 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-16T11:23:37.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:39.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:40.912 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-08-16T11:23:42.928 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-16T11:23:46.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:48.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:49.968 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-08-16T11:23:51.984 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-16T11:23:55.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:57.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:23:59.024 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-08-16T11:24:01.040 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-16T11:24:05.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:24:07.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:24:08.080 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-08-16T11:24:10.096 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-16T11:24:14.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:24:16.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:24:17.136 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-08-16T11:24:19.152 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-16T11:24:23.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:24:25.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:25:23.200 WARNING:teuthology.provision.fog.smithi120:timed out 2023-08-16T11:25:25.160 WARNING:teuthology.provision.fog.smithi183:timed out 2023-08-16T11:25:29.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:25:29.375 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T11:25:29.376 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T11:25:29.692 INFO:teuthology.provision.fog.smithi120:Node is ready 2023-08-16T11:25:29.692 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2023-08-16T11:25:29.707 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2023-08-16T11:25:29.707 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2023-08-16T11:25:29.762 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2023-08-16T11:25:29.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-08-16T11:25:29.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2023-08-16T11:25:29.890 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2023-08-16T11:25:29.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2023-08-16T11:25:30.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-08-16T11:25:30.090 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-08-16T11:25:30.144 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2023-08-16T11:25:30.144 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2023-08-16T11:25:30.144 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2023-08-16T11:25:30.145 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2023-08-16T11:25:30.145 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2023-08-16T11:25:30.145 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2023-08-16T11:25:30.145 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T11:25:30.146 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-08-16T11:25:30.146 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2023-08-16T11:25:30.146 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T11:25:30.146 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2023-08-16T11:25:30.146 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:25:30.146 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T11:25:30.147 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T11:25:30.147 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2023-08-16T11:25:30.149 DEBUG:teuthology.parallel:result is None 2023-08-16T11:25:31.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:25:31.397 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T11:25:31.398 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T11:25:31.718 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-08-16T11:25:31.718 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-08-16T11:25:31.733 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-08-16T11:25:31.733 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-08-16T11:25:31.787 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-08-16T11:25:31.788 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-08-16T11:25:31.899 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-08-16T11:25:31.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-08-16T11:25:31.994 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-08-16T11:25:32.061 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-08-16T11:25:32.127 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-08-16T11:25:32.182 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-08-16T11:25:32.183 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-08-16T11:25:32.183 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-08-16T11:25:32.183 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-08-16T11:25:32.183 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-08-16T11:25:32.183 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-08-16T11:25:32.183 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T11:25:32.183 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-08-16T11:25:32.184 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-08-16T11:25:32.184 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T11:25:32.184 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-08-16T11:25:32.184 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:25:32.184 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T11:25:32.184 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T11:25:32.185 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-08-16T11:25:32.185 DEBUG:teuthology.parallel:result is None 2023-08-16T11:25:32.323 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2023-08-16T11:25:32.324 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-16T11:25:32.343 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-08-16T11:25:32.343 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-16T11:25:32.361 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2023-08-16T11:25:32.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-08-16T11:25:32.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:25:32.446 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-08-16T11:25:32.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-08-16T11:25:32.516 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-08-16T11:25:32.572 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-08-16T11:25:32.572 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-08-16T11:25:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2023-08-16T11:25:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2023-08-16T11:25:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2023-08-16T11:25:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2023-08-16T11:25:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2023-08-16T11:25:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2023-08-16T11:25:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T11:25:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-08-16T11:25:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2023-08-16T11:25:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T11:25:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2023-08-16T11:25:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:25:32.630 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T11:25:32.630 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T11:25:32.630 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-08-16T11:25:32.652 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-08-16T11:25:32.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-08-16T11:25:32.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:25:32.734 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-08-16T11:25:32.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-08-16T11:25:32.802 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-08-16T11:25:32.856 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-08-16T11:25:32.857 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-08-16T11:25:32.910 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-08-16T11:25:32.910 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-08-16T11:25:32.910 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-08-16T11:25:32.910 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-08-16T11:25:32.911 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:25:32.912 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T11:25:32.912 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T11:25:32.912 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-08-16T11:25:32.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:25:33.086 INFO:teuthology.dispatcher.supervisor:Running job 7369822 2023-08-16T11:25:33.087 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-16_11:13:33-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7369822 --name vshankar-2023-08-16_11:13:33-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/vshankar-2023-08-16_11:13:33-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7369822/orig.config.yaml 2023-08-16T11:25:33.090 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-16_11:13:33-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7369822 2023-08-16T11:25:33.091 INFO:teuthology.dispatcher.supervisor:Job PID: 15062 2023-08-16T11:25:33.091 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-16T11:27:33.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:29:33.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:31:33.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:33:33.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:35:33.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:37:34.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:39:34.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:41:34.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:43:34.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:45:34.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:47:34.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:49:34.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:51:35.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:53:35.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:55:35.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:57:35.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:59:35.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:59:35.839 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-16T11:59:36.006 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-16T11:59:36.007 INFO:teuthology.nuke:Checking targets against current locks 2023-08-16T11:59:36.058 DEBUG:teuthology.nuke:shortname: smithi120 2023-08-16T11:59:36.058 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T11:59:36.073 DEBUG:teuthology.nuke:shortname: smithi183 2023-08-16T11:59:36.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T11:59:36.077 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-16_11:13:33-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7369822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 11:20:30.565795', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGd8Aprxr2jRedeZsH9KDNspJfpTudFM/5X3IL+96dnyz07EqT0LzoiaSZg80pW6J0b3hkuU+1P5a5FtgAdcRQg='} 2023-08-16T11:59:36.091 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-16_11:13:33-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7369822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 11:20:30.563998', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDiRKWtwyt7ED4rcEJEuXdCUvbyCIBOmEp50tTU9MB+5c2ry7BX+KpYJHXssB3PE0i6i51OgZvZlMuLmk7bQFNE='} 2023-08-16T11:59:36.124 INFO:teuthology.orchestra.console.smithi120:Power off 2023-08-16T11:59:36.125 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:59:36.145 INFO:teuthology.orchestra.console.smithi183:Power off 2023-08-16T11:59:36.146 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:59:36.156 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2023-08-16T11:59:36.157 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:36.170 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-08-16T11:59:36.171 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:36.181 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-08-16T11:59:36.193 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-08-16T11:59:36.283 INFO:teuthology.orchestra.console.smithi120:Power off completed 2023-08-16T11:59:36.294 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-08-16T11:59:36.429 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2023-08-16T11:59:36.436 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com