2024-04-11T21:23:18.885 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-11T21:23:18.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:23:19.048 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2cb1879c10>, signals=[15]) 2024-04-11T21:23:19.049 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2024-04-11T21:23:19.049 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2024-04-11T21:23:19.049 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-11T21:23:19.068 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2024-04-11T21:23:19.069 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2024-04-11T21:23:19.069 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-11T21:23:19.094 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2024-04-11T21:23:19.094 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2024-04-11T21:23:19.094 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-04-11T21:23:19.188 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_9.stream (ID 10) 2024-04-11T21:23:19.212 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_9.stream (ID 10) 2024-04-11T21:23:19.225 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_9.stream (ID 10) 2024-04-11T21:23:19.230 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 9.stream 2024-04-11T21:23:19.268 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 9.stream 2024-04-11T21:23:19.283 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 9.stream 2024-04-11T21:23:19.496 INFO:teuthology.orchestra.console.smithi073:Power off 2024-04-11T21:23:19.496 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T21:23:19.515 INFO:teuthology.orchestra.console.smithi181:Power off 2024-04-11T21:23:19.515 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T21:23:19.523 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-04-11T21:23:19.523 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:19.537 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-04-11T21:23:19.537 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:19.549 INFO:teuthology.orchestra.console.smithi142:Power off 2024-04-11T21:23:19.549 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T21:23:19.558 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-11T21:23:19.559 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-11T21:23:19.570 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-04-11T21:23:19.570 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:19.592 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-11T21:23:23.562 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:23.569 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:23.593 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:23.672 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-11T21:23:23.678 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-11T21:23:23.701 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-11T21:23:27.674 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:27.681 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:27.702 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:27.784 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-11T21:23:27.790 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-04-11T21:23:27.811 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-11T21:23:27.891 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-04-11T21:23:27.991 INFO:teuthology.orchestra.console.smithi181:Power on 2024-04-11T21:23:27.992 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-11T21:23:28.012 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2024-04-11T21:23:28.012 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:28.032 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-04-11T21:23:31.789 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:31.812 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:31.898 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-04-11T21:23:31.919 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-11T21:23:31.999 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-04-11T21:23:32.019 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-04-11T21:23:32.033 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:32.100 INFO:teuthology.orchestra.console.smithi073:Power on 2024-04-11T21:23:32.100 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-11T21:23:32.119 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2024-04-11T21:23:32.120 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:32.127 INFO:teuthology.orchestra.console.smithi142:Power on 2024-04-11T21:23:32.127 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-11T21:23:32.141 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-11T21:23:32.143 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-04-11T21:23:32.148 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2024-04-11T21:23:32.148 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:32.168 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-11T21:23:32.241 INFO:teuthology.orchestra.console.smithi181:Power on completed 2024-04-11T21:23:32.342 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2024-04-11T21:23:36.146 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:36.168 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T21:23:36.256 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-11T21:23:36.277 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-11T21:23:36.357 INFO:teuthology.orchestra.console.smithi073:Power on completed 2024-04-11T21:23:36.377 INFO:teuthology.orchestra.console.smithi142:Power on completed 2024-04-11T21:23:36.458 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2024-04-11T21:23:36.478 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2024-04-11T21:26:18.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:21.310 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:26:22.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:22.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:25.342 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T21:26:25.343 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-11T21:26:27.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:30.370 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:26:31.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:31.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:34.398 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T21:26:34.399 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-11T21:26:36.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:39.454 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:26:40.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:40.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:43.458 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T21:26:43.459 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-11T21:26:45.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:48.510 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:26:49.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:49.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:52.510 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T21:26:52.542 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-11T21:26:54.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:57.566 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:26:58.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:26:58.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:01.566 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T21:27:01.598 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-11T21:27:03.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:06.622 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:27:07.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:07.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:10.622 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-11T21:27:10.654 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-11T21:27:12.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:16.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:16.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:31.107 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:27:37.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:40.194 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:27:46.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:49.278 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-11T21:27:55.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:27:55.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-11T21:27:55.666 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-11T21:28:11.144 INFO:teuthology.provision.fog.smithi181:Node is ready 2024-04-11T21:28:11.144 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2024-04-11T21:28:11.202 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2024-04-11T21:28:11.202 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2024-04-11T21:28:11.257 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2024-04-11T21:28:11.258 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-04-11T21:28:11.369 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2024-04-11T21:28:11.398 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2024-04-11T21:28:11.465 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2024-04-11T21:28:11.533 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-04-11T21:28:11.598 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-04-11T21:28:11.653 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-04-11T21:28:11.653 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-04-11T21:28:11.653 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-04-11T21:28:11.653 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-04-11T21:28:11.653 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T21:28:11.654 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T21:28:11.655 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2024-04-11T21:28:11.656 DEBUG:teuthology.parallel:result is None 2024-04-11T21:28:16.635 WARNING:teuthology.provision.fog.smithi073:timed out 2024-04-11T21:28:16.658 WARNING:teuthology.provision.fog.smithi142:timed out 2024-04-11T21:28:22.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:28:22.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:28:22.885 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-11T21:28:22.886 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-11T21:28:22.890 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-11T21:28:22.890 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-11T21:28:23.204 INFO:teuthology.provision.fog.smithi142:Node is ready 2024-04-11T21:28:23.204 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2024-04-11T21:28:23.218 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2024-04-11T21:28:23.219 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2024-04-11T21:28:23.221 INFO:teuthology.provision.fog.smithi073:Node is ready 2024-04-11T21:28:23.221 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2024-04-11T21:28:23.236 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2024-04-11T21:28:23.236 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2024-04-11T21:28:23.274 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2024-04-11T21:28:23.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-11T21:28:23.289 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2024-04-11T21:28:23.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-04-11T21:28:23.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2024-04-11T21:28:23.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2024-04-11T21:28:23.403 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2024-04-11T21:28:23.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2024-04-11T21:28:23.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2024-04-11T21:28:23.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2024-04-11T21:28:23.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-11T21:28:23.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-04-11T21:28:23.600 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-11T21:28:23.626 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T21:28:23.654 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-11T21:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-11T21:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T21:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-11T21:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T21:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T21:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T21:28:23.655 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2024-04-11T21:28:23.656 DEBUG:teuthology.parallel:result is None 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-04-11T21:28:23.678 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T21:28:23.679 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T21:28:23.679 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T21:28:23.679 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2024-04-11T21:28:23.679 DEBUG:teuthology.parallel:result is None 2024-04-11T21:28:23.881 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2024-04-11T21:28:23.881 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-11T21:28:23.907 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2024-04-11T21:28:23.907 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-11T21:28:23.923 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2024-04-11T21:28:23.923 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-11T21:28:23.941 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2024-04-11T21:28:23.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T21:28:23.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:28:24.029 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-11T21:28:24.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-11T21:28:24.096 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-04-11T21:28:24.147 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-04-11T21:28:24.148 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T21:28:24.201 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T21:28:24.202 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T21:28:24.202 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-11T21:28:24.223 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2024-04-11T21:28:24.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-11T21:28:24.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:28:24.311 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-11T21:28:24.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-11T21:28:24.376 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-11T21:28:24.430 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-11T21:28:24.430 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-11T21:28:24.484 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-11T21:28:24.484 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-11T21:28:24.484 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-11T21:28:24.484 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-11T21:28:24.484 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T21:28:24.485 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T21:28:24.486 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-11T21:28:24.523 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2024-04-11T21:28:24.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-11T21:28:24.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T21:28:24.610 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-04-11T21:28:24.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-11T21:28:24.776 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-04-11T21:28:24.831 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-04-11T21:28:24.831 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-04-11T21:28:24.885 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-04-11T21:28:24.885 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-04-11T21:28:24.885 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-04-11T21:28:24.885 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-04-11T21:28:24.885 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T21:28:24.886 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T21:28:24.886 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-04-11T21:28:24.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:28:24.992 INFO:teuthology.dispatcher.supervisor:Running job 7652134 2024-04-11T21:28:24.992 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7652134 --name rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} -- /home/teuthworker/archive/rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7652134/orig.config.yaml 2024-04-11T21:28:24.995 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7652134 2024-04-11T21:28:24.996 INFO:teuthology.dispatcher.supervisor:Job PID: 3529342 2024-04-11T21:28:24.996 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-11T21:30:25.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:32:25.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:34:25.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:36:25.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:38:25.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:40:26.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:42:26.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:44:26.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:46:26.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:48:26.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:50:27.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T21:50:27.077 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1