2024-03-10T02:04:20.377 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-10T02:04:20.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:04:20.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8da3155c10>, signals=[15]) 2024-03-10T02:04:20.550 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2024-03-10T02:04:20.550 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2024-03-10T02:04:20.551 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-03-10T02:04:20.575 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2024-03-10T02:04:20.576 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2024-03-10T02:04:20.576 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-03-10T02:04:20.600 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2024-03-10T02:04:20.600 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2024-03-10T02:04:20.600 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-03-10T02:04:20.683 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10) 2024-03-10T02:04:20.713 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_9.stream (ID 10) 2024-03-10T02:04:20.720 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10) 2024-03-10T02:04:20.730 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream 2024-03-10T02:04:20.751 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 9.stream 2024-03-10T02:04:20.761 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream 2024-03-10T02:04:20.997 INFO:teuthology.orchestra.console.smithi092:Power off 2024-03-10T02:04:20.998 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-10T02:04:21.012 INFO:teuthology.orchestra.console.smithi183:Power off 2024-03-10T02:04:21.013 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-10T02:04:21.024 INFO:teuthology.orchestra.console.smithi090:Power off 2024-03-10T02:04:21.024 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-10T02:04:21.033 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2024-03-10T02:04:21.033 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:21.042 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2024-03-10T02:04:21.043 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:21.051 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2024-03-10T02:04:21.051 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:21.058 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-10T02:04:21.063 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-03-10T02:04:21.072 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-03-10T02:04:21.159 INFO:teuthology.orchestra.console.smithi092:Power off completed 2024-03-10T02:04:21.164 INFO:teuthology.orchestra.console.smithi183:Power off completed 2024-03-10T02:04:21.172 INFO:teuthology.orchestra.console.smithi090:Power off completed 2024-03-10T02:04:21.261 INFO:teuthology.orchestra.console.smithi092:Power on 2024-03-10T02:04:21.261 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-10T02:04:21.269 INFO:teuthology.orchestra.console.smithi183:Power on 2024-03-10T02:04:21.269 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-10T02:04:21.275 INFO:teuthology.orchestra.console.smithi090:Power on 2024-03-10T02:04:21.275 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-10T02:04:21.288 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2024-03-10T02:04:21.288 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:21.295 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2024-03-10T02:04:21.295 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:21.302 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2024-03-10T02:04:21.303 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:21.310 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-10T02:04:21.316 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-03-10T02:04:21.322 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-03-10T02:04:25.314 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:25.321 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:25.328 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:25.423 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-10T02:04:25.430 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-03-10T02:04:25.436 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-03-10T02:04:25.531 INFO:teuthology.orchestra.console.smithi183:Power on completed 2024-03-10T02:04:25.632 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2024-03-10T02:04:29.427 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:29.437 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-10T02:04:29.536 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-03-10T02:04:29.544 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-03-10T02:04:29.637 INFO:teuthology.orchestra.console.smithi092:Power on completed 2024-03-10T02:04:29.645 INFO:teuthology.orchestra.console.smithi090:Power on completed 2024-03-10T02:04:29.738 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2024-03-10T02:04:29.746 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2024-03-10T02:07:00.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:03.742 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:07:09.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:11.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:12.830 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:07:14.718 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:07:18.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:20.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:21.890 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:07:23.774 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:07:27.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:29.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:30.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:30.974 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:07:32.830 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:07:33.886 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:07:36.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:38.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:39.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:40.030 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:07:41.886 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:07:42.942 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:07:46.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:47.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:48.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:49.086 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:07:50.943 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:07:52.002 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:07:55.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:56.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:58.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:07:58.142 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:08:00.002 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:08:01.054 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:08:04.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:06.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:07.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:10.110 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:08:16.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:19.170 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:08:22.558 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:08:24.353 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:08:25.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:28.222 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:08:28.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:30.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:31.618 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:08:33.442 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:08:34.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:37.278 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-10T02:08:37.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:39.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:40.670 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-10T02:08:42.526 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-03-10T02:08:43.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:46.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:47.036 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-10T02:08:47.037 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-10T02:08:48.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:08:48.861 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-10T02:08:48.861 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-10T02:09:02.452 INFO:teuthology.provision.fog.smithi092:Node is ready 2024-03-10T02:09:02.452 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2024-03-10T02:09:02.470 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2024-03-10T02:09:02.470 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2024-03-10T02:09:02.529 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2024-03-10T02:09:02.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-03-10T02:09:02.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2024-03-10T02:09:02.664 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2024-03-10T02:09:02.733 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2024-03-10T02:09:02.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-03-10T02:09:02.868 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-10T02:09:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-03-10T02:09:02.924 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-03-10T02:09:02.924 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-10T02:09:02.924 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-03-10T02:09:02.924 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T02:09:02.924 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-10T02:09:02.924 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T02:09:02.925 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2024-03-10T02:09:02.927 DEBUG:teuthology.parallel:result is None 2024-03-10T02:09:04.016 INFO:teuthology.provision.fog.smithi183:Node is ready 2024-03-10T02:09:04.017 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2024-03-10T02:09:04.035 INFO:teuthology.orchestra.run.smithi183.stdout:smithi046 2024-03-10T02:09:04.035 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi046 /etc/hosts 2024-03-10T02:09:04.092 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-10T02:09:04.093 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2024-03-10T02:09:04.221 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi046/smithi183/g' /etc/hosts 2024-03-10T02:09:04.252 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.46/172.21.15.183/g' /etc/hosts 2024-03-10T02:09:04.320 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi046/smithi183/g' /etc/hostname 2024-03-10T02:09:04.389 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2024-03-10T02:09:04.456 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-03-10T02:09:04.511 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-03-10T02:09:04.511 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-03-10T02:09:04.511 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-10T02:09:04.512 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T02:09:04.513 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2024-03-10T02:09:04.513 DEBUG:teuthology.parallel:result is None 2024-03-10T02:09:43.323 WARNING:teuthology.provision.fog.smithi090:timed out 2024-03-10T02:09:49.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:09:49.545 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-10T02:09:49.545 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-10T02:09:49.915 INFO:teuthology.provision.fog.smithi090:Node is ready 2024-03-10T02:09:49.915 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2024-03-10T02:09:49.929 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2024-03-10T02:09:49.930 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2024-03-10T02:09:49.984 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2024-03-10T02:09:49.985 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-03-10T02:09:50.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2024-03-10T02:09:50.136 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2024-03-10T02:09:50.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2024-03-10T02:09:50.271 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-03-10T02:09:50.337 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-03-10T02:09:50.391 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-10T02:09:50.392 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T02:09:50.393 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2024-03-10T02:09:50.393 DEBUG:teuthology.parallel:result is None 2024-03-10T02:09:50.617 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2024-03-10T02:09:50.617 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-10T02:09:50.638 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2024-03-10T02:09:50.638 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-10T02:09:50.654 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2024-03-10T02:09:50.654 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-10T02:09:50.672 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2024-03-10T02:09:50.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-10T02:09:50.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:09:50.764 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-03-10T02:09:50.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-10T02:09:50.828 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-03-10T02:09:50.883 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-03-10T02:09:50.883 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-03-10T02:09:50.937 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T02:09:50.938 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-10T02:09:50.939 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T02:09:50.939 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-03-10T02:09:50.963 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2024-03-10T02:09:50.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-03-10T02:09:50.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:09:51.049 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-03-10T02:09:51.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-03-10T02:09:51.221 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-03-10T02:09:51.275 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-03-10T02:09:51.275 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-03-10T02:09:51.329 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-03-10T02:09:51.329 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-10T02:09:51.330 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T02:09:51.331 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-03-10T02:09:51.354 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2024-03-10T02:09:51.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-03-10T02:09:51.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T02:09:51.444 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-03-10T02:09:51.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-03-10T02:09:51.616 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-03-10T02:09:51.671 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-03-10T02:09:51.671 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-03-10T02:09:51.726 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-03-10T02:09:51.727 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-10T02:09:51.727 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-03-10T02:09:51.727 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T02:09:51.727 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-10T02:09:51.727 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T02:09:51.727 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-03-10T02:09:51.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:09:51.833 INFO:teuthology.dispatcher.supervisor:Running job 7587831 2024-03-10T02:09:51.833 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-08_16:20:46-rados-wip-yuri4-testing-2024-03-05-0854-distro-default-smithi/7587831 --name yuriw-2024-03-08_16:20:46-rados-wip-yuri4-testing-2024-03-05-0854-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} -- /home/teuthworker/archive/yuriw-2024-03-08_16:20:46-rados-wip-yuri4-testing-2024-03-05-0854-distro-default-smithi/7587831/orig.config.yaml 2024-03-10T02:09:51.836 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-08_16:20:46-rados-wip-yuri4-testing-2024-03-05-0854-distro-default-smithi/7587831 2024-03-10T02:09:51.836 INFO:teuthology.dispatcher.supervisor:Job PID: 1915604 2024-03-10T02:09:51.837 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-10T02:11:51.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:13:52.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:15:52.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:17:52.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:19:52.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:21:52.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:23:52.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:25:53.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:27:53.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:29:53.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:31:53.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:33:53.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:35:53.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:37:54.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:39:54.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:41:54.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:43:54.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:45:54.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:47:54.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:49:55.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:51:55.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:53:55.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:55:55.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:57:55.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T02:59:55.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T03:01:56.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T03:03:56.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T03:05:56.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T03:07:56.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T03:09:56.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T03:09:56.838 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1