2024-03-05T17:55:41.255 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-05T17:55:41.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T17:55:41.465 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6906f3ec10>, signals=[15]) 2024-03-05T17:55:41.465 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2024-03-05T17:55:41.465 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2024-03-05T17:55:41.466 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-03-05T17:55:41.489 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2024-03-05T17:55:41.490 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2024-03-05T17:55:41.490 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-03-05T17:55:41.514 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-03-05T17:55:41.514 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-03-05T17:55:41.514 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-05T17:55:41.605 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10) 2024-03-05T17:55:41.629 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2024-03-05T17:55:41.662 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10) 2024-03-05T17:55:41.665 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream 2024-03-05T17:55:41.681 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2024-03-05T17:55:41.710 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream 2024-03-05T17:55:41.968 INFO:teuthology.orchestra.console.smithi039:Power off 2024-03-05T17:55:41.968 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-05T17:55:41.991 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-03-05T17:55:41.991 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:42.016 INFO:teuthology.orchestra.console.smithi194:Power off 2024-03-05T17:55:42.016 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-05T17:55:42.025 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-05T17:55:42.037 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-03-05T17:55:42.037 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:42.050 INFO:teuthology.orchestra.console.smithi196:Power off 2024-03-05T17:55:42.051 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-05T17:55:42.060 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-05T17:55:42.073 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-03-05T17:55:42.073 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:42.097 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-05T17:55:46.028 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:46.061 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:46.099 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:46.137 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-05T17:55:46.169 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-05T17:55:46.207 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-05T17:55:50.142 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:50.170 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:50.208 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:50.251 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-05T17:55:50.279 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-05T17:55:50.317 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-05T17:55:54.253 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:54.280 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:54.318 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:54.363 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-03-05T17:55:54.389 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-03-05T17:55:54.427 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-05T17:55:54.464 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-03-05T17:55:54.490 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-03-05T17:55:54.529 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-03-05T17:55:54.564 INFO:teuthology.orchestra.console.smithi039:Power on 2024-03-05T17:55:54.565 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-05T17:55:54.587 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2024-03-05T17:55:54.588 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:54.595 INFO:teuthology.orchestra.console.smithi194:Power on 2024-03-05T17:55:54.595 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-05T17:55:54.610 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-03-05T17:55:54.617 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2024-03-05T17:55:54.617 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:54.630 INFO:teuthology.orchestra.console.smithi196:Power on 2024-03-05T17:55:54.631 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-05T17:55:54.639 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-03-05T17:55:54.654 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-03-05T17:55:54.654 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:54.675 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-05T17:55:58.612 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:58.639 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:58.676 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-05T17:55:58.721 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-05T17:55:58.748 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-05T17:55:58.784 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-05T17:55:58.822 INFO:teuthology.orchestra.console.smithi039:Power on completed 2024-03-05T17:55:58.848 INFO:teuthology.orchestra.console.smithi194:Power on completed 2024-03-05T17:55:58.886 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-03-05T17:55:58.923 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2024-03-05T17:55:58.950 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2024-03-05T17:55:58.986 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-03-05T17:58:29.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:58:29.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:58:33.056 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-05T17:58:33.056 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-05T17:58:39.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:58:39.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:58:42.144 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-05T17:58:42.144 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-05T17:58:48.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:58:48.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:58:51.228 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-05T17:58:51.228 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-05T17:58:57.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:58:57.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:00.288 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-05T17:59:00.316 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-05T17:59:06.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:06.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:09.376 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-05T17:59:09.376 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-05T17:59:15.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:15.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:15.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:18.336 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T17:59:18.428 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-05T17:59:18.460 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-05T17:59:24.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:24.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:24.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:27.420 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T17:59:27.516 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-05T17:59:33.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:33.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:36.512 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T17:59:42.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:45.600 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T17:59:51.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T17:59:54.688 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T18:00:00.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:00:03.772 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T18:00:09.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:00:12.828 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T18:00:18.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:00:21.888 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T18:00:24.434 WARNING:teuthology.provision.fog.smithi196:timed out 2024-03-05T18:00:27.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:00:30.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:00:30.651 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-05T18:00:30.652 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-05T18:00:30.976 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-05T18:00:30.981 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-03-05T18:00:30.981 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-03-05T18:00:30.996 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2024-03-05T18:00:30.996 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2024-03-05T18:00:31.051 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2024-03-05T18:00:31.052 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-05T18:00:31.156 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2024-03-05T18:00:31.184 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2024-03-05T18:00:31.251 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2024-03-05T18:00:31.318 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-05T18:00:31.384 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-05T18:00:31.439 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-05T18:00:31.440 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-05T18:00:31.440 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-05T18:00:31.440 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-03-05T18:00:31.442 DEBUG:teuthology.parallel:result is None 2024-03-05T18:00:33.520 WARNING:teuthology.provision.fog.smithi194:timed out 2024-03-05T18:00:36.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:00:39.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:00:39.816 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-05T18:00:39.817 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-05T18:00:40.142 INFO:teuthology.provision.fog.smithi194:Node is ready 2024-03-05T18:00:40.142 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2024-03-05T18:00:40.158 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2024-03-05T18:00:40.158 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2024-03-05T18:00:40.214 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2024-03-05T18:00:40.215 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-03-05T18:00:40.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2024-03-05T18:00:40.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2024-03-05T18:00:40.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2024-03-05T18:00:40.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-03-05T18:00:40.571 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-03-05T18:00:40.626 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-05T18:00:40.627 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-05T18:00:40.627 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-05T18:00:40.627 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2024-03-05T18:00:40.627 DEBUG:teuthology.parallel:result is None 2024-03-05T18:01:37.041 WARNING:teuthology.provision.fog.smithi039:timed out 2024-03-05T18:01:43.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:01:43.281 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-05T18:01:43.282 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-05T18:01:43.592 INFO:teuthology.provision.fog.smithi039:Node is ready 2024-03-05T18:01:43.593 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2024-03-05T18:01:43.648 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2024-03-05T18:01:43.649 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2024-03-05T18:01:43.705 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2024-03-05T18:01:43.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-03-05T18:01:43.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2024-03-05T18:01:43.865 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2024-03-05T18:01:43.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2024-03-05T18:01:44.007 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-03-05T18:01:44.077 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-05T18:01:44.132 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-03-05T18:01:44.133 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-05T18:01:44.133 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-05T18:01:44.133 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-05T18:01:44.133 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2024-03-05T18:01:44.133 DEBUG:teuthology.parallel:result is None 2024-03-05T18:01:44.357 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2024-03-05T18:01:44.357 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-05T18:01:44.381 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2024-03-05T18:01:44.381 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-05T18:01:44.405 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2024-03-05T18:01:44.405 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-05T18:01:44.423 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2024-03-05T18:01:44.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-03-05T18:01:44.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:01:44.524 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-03-05T18:01:44.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-03-05T18:01:44.594 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-03-05T18:01:44.650 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-03-05T18:01:44.650 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-03-05T18:01:44.705 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-03-05T18:01:44.705 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-03-05T18:01:44.705 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-03-05T18:01:44.705 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-05T18:01:44.706 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-05T18:01:44.707 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-03-05T18:01:44.731 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2024-03-05T18:01:44.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-05T18:01:44.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:01:44.820 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-03-05T18:01:44.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-05T18:01:44.990 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-03-05T18:01:45.045 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-03-05T18:01:45.045 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-03-05T18:01:45.100 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-03-05T18:01:45.100 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-03-05T18:01:45.100 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-03-05T18:01:45.100 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-03-05T18:01:45.101 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-03-05T18:01:45.101 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-03-05T18:01:45.101 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-05T18:01:45.101 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-03-05T18:01:45.101 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-03-05T18:01:45.102 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-05T18:01:45.102 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-03-05T18:01:45.102 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-05T18:01:45.102 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-05T18:01:45.102 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-05T18:01:45.103 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-03-05T18:01:45.123 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2024-03-05T18:01:45.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-05T18:01:45.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-05T18:01:45.224 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-05T18:01:45.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-05T18:01:45.395 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-03-05T18:01:45.450 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-03-05T18:01:45.450 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-05T18:01:45.505 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-05T18:01:45.506 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-05T18:01:45.506 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-05T18:01:45.506 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-05T18:01:45.506 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-05T18:01:45.506 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-05T18:01:45.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:01:45.618 INFO:teuthology.dispatcher.supervisor:Running job 7582518 2024-03-05T18:01:45.618 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2024-03-05_17:30:06-smoke-wip-rf-compactref-distro-default-smithi/7582518 --name rfriedma-2024-03-05_17:30:06-smoke-wip-rf-compactref-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} -- /home/teuthworker/archive/rfriedma-2024-03-05_17:30:06-smoke-wip-rf-compactref-distro-default-smithi/7582518/orig.config.yaml 2024-03-05T18:01:45.622 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2024-03-05_17:30:06-smoke-wip-rf-compactref-distro-default-smithi/7582518 2024-03-05T18:01:45.622 INFO:teuthology.dispatcher.supervisor:Job PID: 1005553 2024-03-05T18:01:45.622 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-05T18:03:45.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:05:45.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:07:46.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:09:46.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:11:46.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:13:46.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:15:46.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:17:46.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-05T18:17:46.974 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1