2024-04-18T07:57:39.410 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-18T07:57:39.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T07:57:39.588 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb97904dc10>, signals=[15]) 2024-04-18T07:57:39.589 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2024-04-18T07:57:39.589 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T07:57:39.589 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-04-18T07:57:39.617 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2024-04-18T07:57:39.617 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T07:57:39.617 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-04-18T07:57:39.641 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2024-04-18T07:57:39.642 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T07:57:39.642 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-18T07:57:39.733 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T07:57:39.767 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T07:57:39.778 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream 2024-04-18T07:57:39.782 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T07:57:39.828 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream 2024-04-18T07:57:39.832 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 9.stream 2024-04-18T07:57:40.069 INFO:teuthology.orchestra.console.smithi090:Power off 2024-04-18T07:57:40.070 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T07:57:40.092 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2024-04-18T07:57:40.092 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:40.114 INFO:teuthology.orchestra.console.smithi118:Power off 2024-04-18T07:57:40.114 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T07:57:40.122 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-04-18T07:57:40.136 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2024-04-18T07:57:40.136 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:40.150 INFO:teuthology.orchestra.console.smithi122:Power off 2024-04-18T07:57:40.150 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T07:57:40.160 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-18T07:57:40.175 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2024-04-18T07:57:40.176 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:40.201 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-18T07:57:40.223 INFO:teuthology.orchestra.console.smithi090:Power off completed 2024-04-18T07:57:40.261 INFO:teuthology.orchestra.console.smithi118:Power off completed 2024-04-18T07:57:40.302 INFO:teuthology.orchestra.console.smithi122:Power off completed 2024-04-18T07:57:40.324 INFO:teuthology.orchestra.console.smithi090:Power on 2024-04-18T07:57:40.324 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T07:57:40.347 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2024-04-18T07:57:40.348 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:40.361 INFO:teuthology.orchestra.console.smithi118:Power on 2024-04-18T07:57:40.362 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T07:57:40.373 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-04-18T07:57:40.385 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2024-04-18T07:57:40.385 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:40.403 INFO:teuthology.orchestra.console.smithi122:Power on 2024-04-18T07:57:40.403 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T07:57:40.414 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-18T07:57:40.426 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On 2024-04-18T07:57:40.426 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:40.452 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-18T07:57:44.374 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:44.415 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:44.454 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:44.484 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-04-18T07:57:44.525 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-04-18T07:57:44.562 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2024-04-18T07:57:44.626 INFO:teuthology.orchestra.console.smithi118:Power on completed 2024-04-18T07:57:44.664 INFO:teuthology.orchestra.console.smithi122:Power on completed 2024-04-18T07:57:44.727 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2024-04-18T07:57:44.765 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2024-04-18T07:57:48.486 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T07:57:48.595 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-04-18T07:57:48.696 INFO:teuthology.orchestra.console.smithi090:Power on completed 2024-04-18T07:57:48.797 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2024-04-18T08:01:16.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:19.998 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T08:01:26.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:29.054 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T08:01:35.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:36.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:38.110 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T08:01:39.103 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:01:44.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:45.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:47.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:47.166 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T08:01:48.158 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:01:50.174 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:01:53.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:54.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:56.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:01:56.222 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T08:01:57.214 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:01:59.230 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:02:02.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:03.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:05.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:05.278 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T08:02:06.270 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:02:08.286 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:02:11.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:12.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:14.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:14.334 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T08:02:15.326 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:02:17.342 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:02:20.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:21.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:23.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:24.383 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:02:26.398 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:02:30.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:32.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:33.439 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:02:35.454 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:02:39.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:41.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:44.510 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:02:50.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:02:53.598 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:02:57.950 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:02:59.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:03:02.654 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T08:03:03.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:03:07.006 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:03:08.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:03:13.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:03:16.094 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-18T08:03:20.345 WARNING:teuthology.provision.fog.smithi122:timed out 2024-04-18T08:03:22.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:03:25.062 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T08:03:25.063 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T08:03:26.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:03:26.745 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T08:03:26.745 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T08:03:27.083 INFO:teuthology.provision.fog.smithi122:Node is ready 2024-04-18T08:03:27.083 DEBUG:teuthology.orchestra.run.smithi122:> hostname 2024-04-18T08:03:27.098 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2024-04-18T08:03:27.098 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts 2024-04-18T08:03:27.153 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2024-04-18T08:03:27.153 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-18T08:03:27.278 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts 2024-04-18T08:03:27.306 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts 2024-04-18T08:03:27.374 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname 2024-04-18T08:03:27.441 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-18T08:03:27.507 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-18T08:03:27.561 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-18T08:03:27.561 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-04-18T08:03:27.561 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:03:27.562 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:03:27.563 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2024-04-18T08:03:27.565 DEBUG:teuthology.parallel:result is None 2024-04-18T08:03:45.508 INFO:teuthology.provision.fog.smithi090:Node is ready 2024-04-18T08:03:45.509 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2024-04-18T08:03:45.527 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2024-04-18T08:03:45.528 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2024-04-18T08:03:45.586 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2024-04-18T08:03:45.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-04-18T08:03:45.716 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2024-04-18T08:03:45.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2024-04-18T08:03:45.821 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2024-04-18T08:03:45.890 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-04-18T08:03:45.958 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-04-18T08:03:46.013 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-04-18T08:03:46.013 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-04-18T08:03:46.013 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-04-18T08:03:46.013 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:03:46.013 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:03:46.014 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:03:46.014 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2024-04-18T08:03:46.015 DEBUG:teuthology.parallel:result is None 2024-04-18T08:04:08.678 WARNING:teuthology.provision.fog.smithi118:timed out 2024-04-18T08:04:14.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:04:14.988 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T08:04:14.988 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T08:04:15.326 INFO:teuthology.provision.fog.smithi118:Node is ready 2024-04-18T08:04:15.326 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2024-04-18T08:04:15.341 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2024-04-18T08:04:15.342 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2024-04-18T08:04:15.396 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2024-04-18T08:04:15.397 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2024-04-18T08:04:15.507 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2024-04-18T08:04:15.534 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2024-04-18T08:04:15.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2024-04-18T08:04:15.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2024-04-18T08:04:15.773 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-04-18T08:04:15.828 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-04-18T08:04:15.828 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-04-18T08:04:15.828 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-04-18T08:04:15.828 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:04:15.828 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-04-18T08:04:15.828 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:04:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:04:15.829 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2024-04-18T08:04:15.830 DEBUG:teuthology.parallel:result is None 2024-04-18T08:04:16.045 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2024-04-18T08:04:16.046 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T08:04:16.064 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2024-04-18T08:04:16.065 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T08:04:16.089 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2024-04-18T08:04:16.089 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T08:04:16.107 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2024-04-18T08:04:16.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-18T08:04:16.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:04:16.195 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-04-18T08:04:16.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-18T08:04:16.365 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-04-18T08:04:16.419 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-04-18T08:04:16.420 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-04-18T08:04:16.474 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:04:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:04:16.476 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-04-18T08:04:16.498 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2024-04-18T08:04:16.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-18T08:04:16.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:04:16.588 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-04-18T08:04:16.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-18T08:04:16.658 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-04-18T08:04:16.719 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-04-18T08:04:16.720 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-04-18T08:04:16.779 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-04-18T08:04:16.779 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-04-18T08:04:16.779 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:04:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:04:16.781 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-04-18T08:04:16.806 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2024-04-18T08:04:16.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-18T08:04:16.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:04:16.892 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-18T08:04:17.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-18T08:04:17.056 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-18T08:04:17.110 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-18T08:04:17.111 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-18T08:04:17.164 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-18T08:04:17.164 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:04:17.165 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:04:17.166 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-18T08:04:17.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:04:17.280 INFO:teuthology.dispatcher.supervisor:Running job 7658654 2024-04-18T08:04:17.280 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-16_20:16:14-rbd-main-distro-default-smithi/7658654 --name teuthology-2024-04-16_20:16:14-rbd-main-distro-default-smithi --description rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/replicated extra-conf/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} workloads/python_api_tests_with_defaults} -- /home/teuthworker/archive/teuthology-2024-04-16_20:16:14-rbd-main-distro-default-smithi/7658654/orig.config.yaml 2024-04-18T08:04:17.284 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-16_20:16:14-rbd-main-distro-default-smithi/7658654 2024-04-18T08:04:17.284 INFO:teuthology.dispatcher.supervisor:Job PID: 2551325 2024-04-18T08:04:17.284 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T08:06:17.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:08:17.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:10:17.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:12:17.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:12:17.958 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1