2024-04-01T02:11:53.874 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T02:11:53.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:11:54.056 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feb64d6fc10>, signals=[15]) 2024-04-01T02:11:54.057 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2024-04-01T02:11:54.057 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T02:11:54.057 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-04-01T02:11:54.077 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-04-01T02:11:54.078 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T02:11:54.078 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-01T02:11:54.093 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2024-04-01T02:11:54.094 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T02:11:54.094 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-04-01T02:11:54.200 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T02:11:54.213 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T02:11:54.227 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T02:11:54.239 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream 2024-04-01T02:11:54.259 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream 2024-04-01T02:11:54.270 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream 2024-04-01T02:11:54.452 INFO:teuthology.orchestra.console.smithi026:Power off 2024-04-01T02:11:54.452 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T02:11:54.478 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-04-01T02:11:54.478 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:11:54.498 INFO:teuthology.orchestra.console.smithi179:Power off 2024-04-01T02:11:54.499 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T02:11:54.511 INFO:teuthology.orchestra.console.smithi188:Power off 2024-04-01T02:11:54.512 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T02:11:54.520 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-01T02:11:54.520 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-04-01T02:11:54.520 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:11:54.533 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-04-01T02:11:54.533 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:11:54.544 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-01T02:11:54.559 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-04-01T02:11:58.522 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:11:58.545 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:11:58.560 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:11:58.633 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-01T02:11:58.655 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-01T02:11:58.669 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-04-01T02:12:02.635 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:02.657 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:02.669 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:02.745 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-04-01T02:12:02.765 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-01T02:12:02.777 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-04-01T02:12:02.846 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-04-01T02:12:02.866 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-04-01T02:12:02.878 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-04-01T02:12:02.947 INFO:teuthology.orchestra.console.smithi026:Power on 2024-04-01T02:12:02.947 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T02:12:02.967 INFO:teuthology.orchestra.console.smithi179:Power on 2024-04-01T02:12:02.968 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T02:12:02.976 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2024-04-01T02:12:02.977 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:02.984 INFO:teuthology.orchestra.console.smithi188:Power on 2024-04-01T02:12:02.984 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T02:12:02.993 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-04-01T02:12:02.993 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:03.001 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-04-01T02:12:03.006 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2024-04-01T02:12:03.006 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:03.016 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-01T02:12:03.031 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-04-01T02:12:07.006 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:07.017 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:07.032 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:07.116 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-04-01T02:12:07.126 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-01T02:12:07.140 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-04-01T02:12:07.228 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-04-01T02:12:07.328 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-04-01T02:12:11.120 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:11.141 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:12:11.229 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-01T02:12:11.251 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-04-01T02:12:11.330 INFO:teuthology.orchestra.console.smithi026:Power on completed 2024-04-01T02:12:11.352 INFO:teuthology.orchestra.console.smithi188:Power on completed 2024-04-01T02:12:11.431 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2024-04-01T02:12:11.452 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2024-04-01T02:14:27.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:14:30.178 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:14:36.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:14:39.266 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:14:42.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:14:45.214 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T02:14:45.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:14:48.318 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:14:51.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:14:53.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:14:54.274 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T02:14:54.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:14:56.222 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T02:14:57.374 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:15:00.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:02.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:03.358 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T02:15:03.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:05.282 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T02:15:06.434 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:15:09.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:11.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:12.414 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T02:15:12.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:14.366 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T02:15:18.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:20.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:21.470 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T02:15:23.426 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T02:15:27.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:29.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:30.526 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T02:15:30.846 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:15:32.510 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T02:15:36.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:36.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:38.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:39.906 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:15:41.566 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T02:15:45.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:47.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:48.990 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-01T02:15:54.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:15:55.387 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T02:15:55.388 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T02:16:06.041 INFO:teuthology.provision.fog.smithi026:Node is ready 2024-04-01T02:16:06.041 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2024-04-01T02:16:06.060 INFO:teuthology.orchestra.run.smithi026.stdout:smithi046 2024-04-01T02:16:06.060 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi046 /etc/hosts 2024-04-01T02:16:06.118 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-01T02:16:06.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-04-01T02:16:06.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi046/smithi026/g' /etc/hosts 2024-04-01T02:16:06.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.46/172.21.15.26/g' /etc/hosts 2024-04-01T02:16:06.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi046/smithi026/g' /etc/hostname 2024-04-01T02:16:06.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-04-01T02:16:06.508 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T02:16:06.564 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-04-01T02:16:06.565 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T02:16:06.565 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T02:16:06.565 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T02:16:06.565 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2024-04-01T02:16:06.567 DEBUG:teuthology.parallel:result is None 2024-04-01T02:16:36.563 WARNING:teuthology.provision.fog.smithi188:timed out 2024-04-01T02:16:42.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:16:42.850 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T02:16:42.851 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T02:16:43.199 INFO:teuthology.provision.fog.smithi188:Node is ready 2024-04-01T02:16:43.199 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2024-04-01T02:16:43.214 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2024-04-01T02:16:43.214 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2024-04-01T02:16:43.270 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2024-04-01T02:16:43.270 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-04-01T02:16:43.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2024-04-01T02:16:43.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2024-04-01T02:16:43.500 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2024-04-01T02:16:43.567 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-04-01T02:16:43.634 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T02:16:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-04-01T02:16:43.690 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T02:16:43.690 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T02:16:43.690 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T02:16:43.690 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2024-04-01T02:16:43.691 DEBUG:teuthology.parallel:result is None 2024-04-01T02:16:47.574 WARNING:teuthology.provision.fog.smithi179:timed out 2024-04-01T02:16:53.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:16:53.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T02:16:53.857 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T02:16:54.155 INFO:teuthology.provision.fog.smithi179:Node is ready 2024-04-01T02:16:54.156 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2024-04-01T02:16:54.171 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2024-04-01T02:16:54.171 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2024-04-01T02:16:54.226 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2024-04-01T02:16:54.226 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-01T02:16:54.324 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2024-04-01T02:16:54.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2024-04-01T02:16:54.420 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2024-04-01T02:16:54.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-01T02:16:54.555 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-01T02:16:54.609 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-01T02:16:54.609 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-01T02:16:54.609 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-01T02:16:54.609 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-01T02:16:54.609 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-01T02:16:54.609 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T02:16:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T02:16:54.611 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2024-04-01T02:16:54.611 DEBUG:teuthology.parallel:result is None 2024-04-01T02:16:54.830 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2024-04-01T02:16:54.833 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T02:16:54.857 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2024-04-01T02:16:54.857 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T02:16:54.873 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2024-04-01T02:16:54.873 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T02:16:54.891 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2024-04-01T02:16:54.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-01T02:16:54.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:16:55.011 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-04-01T02:16:55.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-01T02:16:55.193 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-04-01T02:16:55.249 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-04-01T02:16:55.249 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T02:16:55.304 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-04-01T02:16:55.305 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T02:16:55.305 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T02:16:55.305 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T02:16:55.305 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-04-01T02:16:55.341 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2024-04-01T02:16:55.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T02:16:55.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:16:55.429 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-01T02:16:55.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T02:16:55.497 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-04-01T02:16:55.552 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-04-01T02:16:55.553 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T02:16:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-01T02:16:55.609 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-01T02:16:55.610 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T02:16:55.610 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-01T02:16:55.610 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T02:16:55.610 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T02:16:55.610 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T02:16:55.610 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-01T02:16:55.632 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2024-04-01T02:16:55.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T02:16:55.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T02:16:55.720 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-01T02:16:55.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T02:16:55.884 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-04-01T02:16:55.939 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-04-01T02:16:55.940 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-04-01T02:16:55.994 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-04-01T02:16:55.994 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-04-01T02:16:55.994 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-04-01T02:16:55.994 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-04-01T02:16:55.994 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-04-01T02:16:55.994 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-04-01T02:16:55.994 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T02:16:55.995 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-04-01T02:16:55.995 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-04-01T02:16:55.995 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T02:16:55.995 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-04-01T02:16:55.995 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T02:16:55.995 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T02:16:55.995 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T02:16:55.995 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-04-01T02:16:56.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:16:56.122 INFO:teuthology.dispatcher.supervisor:Running job 7633289 2024-04-01T02:16:56.122 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633289 --name teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633289/orig.config.yaml 2024-04-01T02:16:56.125 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633289 2024-04-01T02:16:56.125 INFO:teuthology.dispatcher.supervisor:Job PID: 3541725 2024-04-01T02:16:56.125 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T02:18:56.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:20:56.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:22:56.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:24:56.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:26:56.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:28:56.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:30:57.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:32:57.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:34:57.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:36:57.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:38:57.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:40:57.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:42:58.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:44:58.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:46:58.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:48:58.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:50:58.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:52:59.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:54:59.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:56:59.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:58:59.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:00:59.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:02:59.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:05:00.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:05:00.143 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1