2024-02-05T15:12:52.898 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-05T15:12:52.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:12:53.070 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff625bc6c10>, signals=[15]) 2024-02-05T15:12:53.071 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2024-02-05T15:12:53.071 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2024-02-05T15:12:53.071 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-02-05T15:12:53.096 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2024-02-05T15:12:53.096 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2024-02-05T15:12:53.097 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-05T15:12:53.120 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2024-02-05T15:12:53.120 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2024-02-05T15:12:53.120 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-02-05T15:12:53.212 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_9.stream (ID 10) 2024-02-05T15:12:53.228 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10) 2024-02-05T15:12:53.254 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_centos_9.stream (ID 10) 2024-02-05T15:12:53.268 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 9.stream 2024-02-05T15:12:53.276 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream 2024-02-05T15:12:53.293 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 9.stream 2024-02-05T15:12:53.492 INFO:teuthology.orchestra.console.smithi103:Power off 2024-02-05T15:12:53.492 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-05T15:12:53.507 INFO:teuthology.orchestra.console.smithi080:Power off 2024-02-05T15:12:53.507 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-05T15:12:53.518 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2024-02-05T15:12:53.518 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:12:53.532 INFO:teuthology.orchestra.console.smithi160:Power off 2024-02-05T15:12:53.532 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-05T15:12:53.540 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-02-05T15:12:53.540 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:12:53.547 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-05T15:12:53.554 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-02-05T15:12:53.554 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:12:53.562 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-02-05T15:12:53.577 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-02-05T15:12:53.663 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-02-05T15:12:53.764 INFO:teuthology.orchestra.console.smithi080:Power on 2024-02-05T15:12:53.764 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-05T15:12:53.787 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2024-02-05T15:12:53.788 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:12:53.809 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-02-05T15:12:57.549 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:12:57.578 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:12:57.659 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-05T15:12:57.687 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-02-05T15:12:57.809 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:12:57.919 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-02-05T15:13:01.664 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:01.687 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:01.773 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-05T15:13:01.796 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-02-05T15:13:01.920 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:02.029 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-05T15:13:02.130 INFO:teuthology.orchestra.console.smithi080:Power on completed 2024-02-05T15:13:02.230 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2024-02-05T15:13:05.776 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:05.797 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:05.885 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-05T15:13:05.905 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-02-05T15:13:05.987 INFO:teuthology.orchestra.console.smithi103:Power off completed 2024-02-05T15:13:06.006 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-02-05T15:13:06.088 INFO:teuthology.orchestra.console.smithi103:Power on 2024-02-05T15:13:06.088 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-05T15:13:06.107 INFO:teuthology.orchestra.console.smithi160:Power on 2024-02-05T15:13:06.108 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-05T15:13:06.116 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2024-02-05T15:13:06.116 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:06.130 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2024-02-05T15:13:06.131 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:06.139 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-05T15:13:06.152 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-02-05T15:13:10.141 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:10.153 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:10.251 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-05T15:13:10.261 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-02-05T15:13:10.362 INFO:teuthology.orchestra.console.smithi160:Power on completed 2024-02-05T15:13:10.463 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2024-02-05T15:13:14.255 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T15:13:14.365 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-05T15:13:14.466 INFO:teuthology.orchestra.console.smithi103:Power on completed 2024-02-05T15:13:14.566 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2024-02-05T15:15:47.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:15:50.944 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-05T15:15:56.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:15:56.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:15:59.228 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-05T15:16:00.028 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-05T15:16:00.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:03.292 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:16:05.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:06.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:08.284 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-05T15:16:09.084 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-05T15:16:09.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:12.348 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:16:14.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:15.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:17.340 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-05T15:16:18.140 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-05T15:16:18.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:21.404 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:16:23.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:24.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:26.396 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-05T15:16:27.196 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-05T15:16:27.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:30.460 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:16:32.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:33.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:35.452 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-05T15:16:36.252 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-05T15:16:36.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:39.516 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:16:41.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:42.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:44.508 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-05T15:16:45.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:48.572 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:16:50.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:54.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:16:57.628 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:17:03.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:17:06.684 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-05T15:17:12.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:17:42.285 WARNING:teuthology.provision.fog.smithi080:timed out 2024-02-05T15:17:48.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:17:48.678 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-05T15:17:48.679 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-05T15:17:49.017 INFO:teuthology.provision.fog.smithi080:Node is ready 2024-02-05T15:17:49.017 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2024-02-05T15:17:49.032 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2024-02-05T15:17:49.032 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2024-02-05T15:17:49.087 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2024-02-05T15:17:49.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-02-05T15:17:49.185 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2024-02-05T15:17:49.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2024-02-05T15:17:49.280 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2024-02-05T15:17:49.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-02-05T15:17:49.413 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-02-05T15:17:49.467 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-02-05T15:17:49.467 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-02-05T15:17:49.467 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-02-05T15:17:49.467 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-02-05T15:17:49.467 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T15:17:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T15:17:49.469 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2024-02-05T15:17:49.470 DEBUG:teuthology.parallel:result is None 2024-02-05T15:17:50.514 WARNING:teuthology.provision.fog.smithi160:timed out 2024-02-05T15:17:56.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:17:56.746 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-05T15:17:56.746 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-05T15:17:57.067 INFO:teuthology.provision.fog.smithi160:Node is ready 2024-02-05T15:17:57.068 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2024-02-05T15:17:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2024-02-05T15:17:57.083 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2024-02-05T15:17:57.139 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2024-02-05T15:17:57.139 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2024-02-05T15:17:57.255 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2024-02-05T15:17:57.282 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2024-02-05T15:17:57.350 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2024-02-05T15:17:57.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2024-02-05T15:17:57.483 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-02-05T15:17:57.537 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-02-05T15:17:57.537 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T15:17:57.538 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T15:17:57.538 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2024-02-05T15:17:57.539 DEBUG:teuthology.parallel:result is None 2024-02-05T15:18:12.704 WARNING:teuthology.provision.fog.smithi103:timed out 2024-02-05T15:18:18.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:18:19.220 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-05T15:18:19.220 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-05T15:18:19.556 INFO:teuthology.provision.fog.smithi103:Node is ready 2024-02-05T15:18:19.556 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2024-02-05T15:18:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2024-02-05T15:18:19.571 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2024-02-05T15:18:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2024-02-05T15:18:19.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-02-05T15:18:19.737 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2024-02-05T15:18:19.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2024-02-05T15:18:19.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2024-02-05T15:18:19.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-02-05T15:18:19.965 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-05T15:18:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-02-05T15:18:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-02-05T15:18:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-02-05T15:18:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-02-05T15:18:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-02-05T15:18:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-02-05T15:18:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T15:18:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-02-05T15:18:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-02-05T15:18:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T15:18:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-02-05T15:18:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T15:18:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T15:18:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T15:18:20.019 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2024-02-05T15:18:20.020 DEBUG:teuthology.parallel:result is None 2024-02-05T15:18:20.232 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2024-02-05T15:18:20.232 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-05T15:18:20.261 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2024-02-05T15:18:20.262 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-05T15:18:20.278 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2024-02-05T15:18:20.278 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-05T15:18:20.296 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2024-02-05T15:18:20.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-05T15:18:20.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:18:20.384 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-05T15:18:20.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-05T15:18:20.550 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-02-05T15:18:20.605 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-02-05T15:18:20.605 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-02-05T15:18:20.660 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T15:18:20.660 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T15:18:20.660 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T15:18:20.660 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-02-05T15:18:20.678 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2024-02-05T15:18:20.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-05T15:18:20.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:18:20.765 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-02-05T15:18:20.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-05T15:18:20.834 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-02-05T15:18:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-02-05T15:18:20.889 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-02-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T15:18:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-02-05T15:18:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T15:18:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T15:18:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T15:18:20.945 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-05T15:18:20.970 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2024-02-05T15:18:20.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-05T15:18:20.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T15:18:21.064 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-02-05T15:18:21.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-05T15:18:21.230 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-02-05T15:18:21.284 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-02-05T15:18:21.284 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-02-05T15:18:21.339 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-02-05T15:18:21.339 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-02-05T15:18:21.339 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-02-05T15:18:21.339 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T15:18:21.340 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T15:18:21.341 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-02-05T15:18:21.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:18:21.447 INFO:teuthology.dispatcher.supervisor:Running job 7546878 2024-02-05T15:18:21.447 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2024-02-05_13:08:40-orch:cephadm-wip-guits-testing-3-2024-02-05-0946-distro-default-smithi/7546878 --name gabrioux-2024-02-05_13:08:40-orch:cephadm-wip-guits-testing-3-2024-02-05-0946-distro-default-smithi --description orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} -- /home/teuthworker/archive/gabrioux-2024-02-05_13:08:40-orch:cephadm-wip-guits-testing-3-2024-02-05-0946-distro-default-smithi/7546878/orig.config.yaml 2024-02-05T15:18:21.451 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2024-02-05_13:08:40-orch:cephadm-wip-guits-testing-3-2024-02-05-0946-distro-default-smithi/7546878 2024-02-05T15:18:21.451 INFO:teuthology.dispatcher.supervisor:Job PID: 2982833 2024-02-05T15:18:21.451 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-05T15:20:21.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:22:21.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:24:21.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:26:22.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:28:22.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:30:22.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:32:22.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:34:22.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:36:22.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:38:23.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:40:23.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:42:23.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T15:42:23.428 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-05T15:42:23.539 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi080 but it was locked by another job: /home/teuthworker/archive/gabrioux-2024-02-05_13:08:40-orch:cephadm-wip-guits-testing-3-2024-02-05-0946-distro-default-smithi/7546893 2024-02-05T15:42:23.540 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/gabrioux-2024-02-05_13:08:40-orch:cephadm-wip-guits-testing-3-2024-02-05-0946-distro-default-smithi/7546889 2024-02-05T15:42:23.540 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi160 but it was locked by another job: /home/teuthworker/archive/gabrioux-2024-02-05_13:08:40-orch:cephadm-wip-guits-testing-3-2024-02-05-0946-distro-default-smithi/7546889