2024-03-11T22:11:28.713 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-11T22:11:28.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:11:28.904 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdfc2a70c10>, signals=[15]) 2024-03-11T22:11:28.905 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2024-03-11T22:11:28.905 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T22:11:28.905 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-03-11T22:11:28.926 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2024-03-11T22:11:28.927 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T22:11:28.927 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-03-11T22:11:28.951 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-03-11T22:11:28.951 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T22:11:28.951 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-11T22:11:29.051 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T22:11:29.074 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T22:11:29.085 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T22:11:29.095 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream 2024-03-11T22:11:29.111 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 9.stream 2024-03-11T22:11:29.128 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream 2024-03-11T22:11:29.315 INFO:teuthology.orchestra.console.smithi032:Power off 2024-03-11T22:11:29.315 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T22:11:29.330 INFO:teuthology.orchestra.console.smithi196:Power off 2024-03-11T22:11:29.331 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T22:11:29.342 INFO:teuthology.orchestra.console.smithi170:Power off 2024-03-11T22:11:29.342 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T22:11:29.350 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-03-11T22:11:29.350 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:29.361 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-03-11T22:11:29.361 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:29.369 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-03-11T22:11:29.369 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:29.377 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-03-11T22:11:29.382 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-11T22:11:29.390 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-11T22:11:33.382 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:33.391 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:33.398 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:33.493 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-03-11T22:11:33.501 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-11T22:11:33.508 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-11T22:11:37.494 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:37.502 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:37.511 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:37.605 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-03-11T22:11:37.613 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-11T22:11:37.621 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-11T22:11:37.706 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-03-11T22:11:37.713 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-03-11T22:11:37.722 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-03-11T22:11:37.808 INFO:teuthology.orchestra.console.smithi032:Power on 2024-03-11T22:11:37.808 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T22:11:37.815 INFO:teuthology.orchestra.console.smithi196:Power on 2024-03-11T22:11:37.816 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T22:11:37.823 INFO:teuthology.orchestra.console.smithi170:Power on 2024-03-11T22:11:37.823 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T22:11:37.831 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2024-03-11T22:11:37.831 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:37.839 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-03-11T22:11:37.839 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:37.847 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2024-03-11T22:11:37.847 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:37.856 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-03-11T22:11:37.859 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-11T22:11:37.868 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-11T22:11:41.858 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:41.866 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:41.874 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:41.968 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-03-11T22:11:41.976 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-11T22:11:41.985 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-11T22:11:45.970 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:45.980 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:45.988 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:11:46.082 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-03-11T22:11:46.090 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-11T22:11:46.182 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-11T22:11:46.183 INFO:teuthology.orchestra.console.smithi032:Power on completed 2024-03-11T22:11:46.191 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-03-11T22:11:46.283 INFO:teuthology.orchestra.console.smithi170:Power on completed 2024-03-11T22:11:46.284 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2024-03-11T22:11:46.292 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-03-11T22:11:46.384 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2024-03-11T22:14:02.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:05.118 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-11T22:14:11.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:14.178 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-11T22:14:17.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:17.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:20.162 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-11T22:14:20.163 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T22:14:20.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:23.234 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-11T22:14:26.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:26.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:29.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:29.251 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-11T22:14:29.252 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T22:14:32.322 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-11T22:14:35.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:35.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:38.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:38.334 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T22:14:38.334 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-11T22:14:41.406 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-11T22:14:44.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:44.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:47.394 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T22:14:47.394 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-11T22:14:47.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:53.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:53.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:14:56.482 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T22:14:56.483 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-11T22:15:02.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:15:02.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:15:05.569 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T22:15:05.570 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-11T22:15:11.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:15:11.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:15:14.654 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T22:15:20.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:15:47.435 WARNING:teuthology.provision.fog.smithi032:timed out 2024-03-11T22:15:53.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:15:53.738 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T22:15:53.738 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T22:15:54.067 INFO:teuthology.provision.fog.smithi032:Node is ready 2024-03-11T22:15:54.067 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2024-03-11T22:15:54.082 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2024-03-11T22:15:54.082 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2024-03-11T22:15:54.137 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2024-03-11T22:15:54.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-03-11T22:15:54.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2024-03-11T22:15:54.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2024-03-11T22:15:54.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2024-03-11T22:15:54.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-03-11T22:15:54.498 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-03-11T22:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-03-11T22:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-03-11T22:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-03-11T22:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-03-11T22:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-03-11T22:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T22:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T22:15:54.555 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2024-03-11T22:15:54.556 DEBUG:teuthology.parallel:result is None 2024-03-11T22:16:11.592 WARNING:teuthology.provision.fog.smithi196:timed out 2024-03-11T22:16:17.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:16:17.947 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T22:16:17.947 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T22:16:18.243 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-03-11T22:16:18.243 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-03-11T22:16:18.257 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2024-03-11T22:16:18.258 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2024-03-11T22:16:18.313 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2024-03-11T22:16:18.313 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-11T22:16:18.419 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2024-03-11T22:16:18.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2024-03-11T22:16:18.513 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2024-03-11T22:16:18.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-11T22:16:18.648 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T22:16:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-11T22:16:18.704 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T22:16:18.704 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T22:16:18.704 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T22:16:18.704 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-03-11T22:16:18.705 DEBUG:teuthology.parallel:result is None 2024-03-11T22:16:20.667 WARNING:teuthology.provision.fog.smithi170:timed out 2024-03-11T22:16:26.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:16:26.888 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T22:16:26.888 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T22:16:27.202 INFO:teuthology.provision.fog.smithi170:Node is ready 2024-03-11T22:16:27.202 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2024-03-11T22:16:27.217 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2024-03-11T22:16:27.217 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2024-03-11T22:16:27.275 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2024-03-11T22:16:27.276 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-03-11T22:16:27.385 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2024-03-11T22:16:27.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2024-03-11T22:16:27.483 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2024-03-11T22:16:27.554 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-03-11T22:16:27.624 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-03-11T22:16:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T22:16:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-03-11T22:16:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T22:16:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T22:16:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T22:16:27.683 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2024-03-11T22:16:27.684 DEBUG:teuthology.parallel:result is None 2024-03-11T22:16:27.928 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2024-03-11T22:16:27.929 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T22:16:27.951 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2024-03-11T22:16:27.951 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T22:16:27.975 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2024-03-11T22:16:27.976 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T22:16:27.993 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2024-03-11T22:16:27.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-11T22:16:27.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:16:28.098 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-03-11T22:16:28.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-11T22:16:28.281 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-03-11T22:16:28.336 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-03-11T22:16:28.336 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-03-11T22:16:28.390 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T22:16:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T22:16:28.392 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-03-11T22:16:28.417 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2024-03-11T22:16:28.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-11T22:16:28.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:16:28.502 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-03-11T22:16:28.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-11T22:16:28.569 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-03-11T22:16:28.623 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-03-11T22:16:28.624 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T22:16:28.680 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-03-11T22:16:28.681 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T22:16:28.681 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T22:16:28.681 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T22:16:28.681 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-03-11T22:16:28.709 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2024-03-11T22:16:28.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-11T22:16:28.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T22:16:28.801 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-11T22:16:28.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-11T22:16:28.965 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-03-11T22:16:29.019 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-03-11T22:16:29.020 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-11T22:16:29.074 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-11T22:16:29.074 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-11T22:16:29.074 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-11T22:16:29.074 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-11T22:16:29.074 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-11T22:16:29.074 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T22:16:29.075 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T22:16:29.075 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-11T22:16:29.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:16:29.185 INFO:teuthology.dispatcher.supervisor:Running job 7591992 2024-03-11T22:16:29.185 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591992 --name teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi --description orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} -- /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591992/orig.config.yaml 2024-03-11T22:16:29.188 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591992 2024-03-11T22:16:29.188 INFO:teuthology.dispatcher.supervisor:Job PID: 3951042 2024-03-11T22:16:29.188 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-11T22:18:29.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:20:29.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:22:29.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:24:29.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:26:29.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:28:30.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:30:30.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:32:30.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:32:30.491 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1