2024-03-25T22:52:08.722 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-25T22:52:08.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T22:52:08.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feab3f3cc10>, signals=[15]) 2024-03-25T22:52:08.910 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2024-03-25T22:52:08.910 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T22:52:08.910 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-03-25T22:52:08.929 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2024-03-25T22:52:08.929 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T22:52:08.930 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-03-25T22:52:08.954 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2024-03-25T22:52:08.954 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T22:52:08.954 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-03-25T22:52:09.083 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_8.stream (ID 3) 2024-03-25T22:52:09.088 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_8.stream (ID 3) 2024-03-25T22:52:09.090 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_8.stream (ID 3) 2024-03-25T22:52:09.140 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream 2024-03-25T22:52:09.144 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 8.stream 2024-03-25T22:52:09.149 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 8.stream 2024-03-25T22:52:09.440 INFO:teuthology.orchestra.console.smithi080:Power off 2024-03-25T22:52:09.440 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T22:52:09.459 INFO:teuthology.orchestra.console.smithi193:Power off 2024-03-25T22:52:09.460 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T22:52:09.473 INFO:teuthology.orchestra.console.smithi003:Power off 2024-03-25T22:52:09.474 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T22:52:09.482 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-03-25T22:52:09.483 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:09.491 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2024-03-25T22:52:09.492 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:09.501 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2024-03-25T22:52:09.502 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:09.510 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-25T22:52:09.514 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-03-25T22:52:09.525 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-03-25T22:52:13.515 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:13.522 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:13.529 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:13.625 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-25T22:52:13.631 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-03-25T22:52:13.640 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-03-25T22:52:17.626 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:17.635 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:17.642 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:17.737 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-03-25T22:52:17.744 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-03-25T22:52:17.753 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-03-25T22:52:17.838 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-03-25T22:52:17.939 INFO:teuthology.orchestra.console.smithi080:Power on 2024-03-25T22:52:17.939 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T22:52:17.962 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2024-03-25T22:52:17.962 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:17.985 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-03-25T22:52:21.749 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:21.756 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:21.858 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-03-25T22:52:21.865 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-03-25T22:52:21.959 INFO:teuthology.orchestra.console.smithi193:Power off completed 2024-03-25T22:52:21.966 INFO:teuthology.orchestra.console.smithi003:Power off completed 2024-03-25T22:52:21.986 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:22.061 INFO:teuthology.orchestra.console.smithi193:Power on 2024-03-25T22:52:22.061 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T22:52:22.068 INFO:teuthology.orchestra.console.smithi003:Power on 2024-03-25T22:52:22.069 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T22:52:22.083 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2024-03-25T22:52:22.083 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:22.091 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2024-03-25T22:52:22.092 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:22.100 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-03-25T22:52:22.104 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-03-25T22:52:22.113 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-03-25T22:52:26.102 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:26.110 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:26.117 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:26.219 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-03-25T22:52:26.227 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-03-25T22:52:26.234 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-25T22:52:26.320 INFO:teuthology.orchestra.console.smithi193:Power on completed 2024-03-25T22:52:26.335 INFO:teuthology.orchestra.console.smithi080:Power on completed 2024-03-25T22:52:26.421 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2024-03-25T22:52:26.437 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2024-03-25T22:52:30.231 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T22:52:30.406 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-03-25T22:52:30.507 INFO:teuthology.orchestra.console.smithi003:Power on completed 2024-03-25T22:52:30.608 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2024-03-25T22:55:01.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:04.446 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-25T22:55:10.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:12.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:12.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:13.502 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-25T22:55:15.327 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-25T22:55:15.327 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-25T22:55:19.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:21.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:21.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:22.558 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-25T22:55:24.382 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-25T22:55:24.383 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-25T22:55:28.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:30.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:30.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:31.614 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-25T22:55:33.442 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-25T22:55:33.443 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-25T22:55:37.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:39.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:39.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:40.674 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-25T22:55:42.530 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-25T22:55:42.531 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-25T22:55:46.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:48.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:48.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:51.614 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-25T22:55:51.615 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-25T22:55:57.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:55:57.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:56:00.670 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-25T22:56:06.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:56:16.159 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-25T22:56:22.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:56:25.214 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-25T22:56:31.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:56:33.517 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T22:56:33.517 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T22:56:38.456 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T22:56:38.456 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T22:56:46.680 WARNING:teuthology.provision.fog.smithi003:timed out 2024-03-25T22:56:52.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:56:52.930 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T22:56:52.931 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T22:56:53.223 INFO:teuthology.provision.fog.smithi003:Node is ready 2024-03-25T22:56:53.224 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2024-03-25T22:56:53.244 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2024-03-25T22:56:53.245 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2024-03-25T22:56:53.305 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2024-03-25T22:56:53.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-03-25T22:56:53.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2024-03-25T22:56:53.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2024-03-25T22:56:53.514 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2024-03-25T22:56:53.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-03-25T22:56:53.653 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-03-25T22:56:53.711 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-03-25T22:56:53.711 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T22:56:53.712 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T22:56:53.713 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2024-03-25T22:56:53.714 DEBUG:teuthology.parallel:result is None 2024-03-25T22:56:59.009 INFO:teuthology.provision.fog.smithi193:Node is ready 2024-03-25T22:56:59.009 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2024-03-25T22:56:59.034 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2024-03-25T22:56:59.034 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2024-03-25T22:56:59.095 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2024-03-25T22:56:59.096 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2024-03-25T22:56:59.213 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2024-03-25T22:56:59.244 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2024-03-25T22:56:59.312 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2024-03-25T22:56:59.382 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2024-03-25T22:56:59.449 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-03-25T22:56:59.507 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-03-25T22:56:59.507 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2024-03-25T22:56:59.507 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-03-25T22:56:59.507 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-03-25T22:56:59.507 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2024-03-25T22:56:59.507 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2024-03-25T22:56:59.507 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T22:56:59.508 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-03-25T22:56:59.508 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T22:56:59.508 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-03-25T22:56:59.508 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T22:56:59.508 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T22:56:59.508 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T22:56:59.508 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2024-03-25T22:56:59.509 DEBUG:teuthology.parallel:result is None 2024-03-25T22:57:03.909 INFO:teuthology.provision.fog.smithi080:Node is ready 2024-03-25T22:57:03.909 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2024-03-25T22:57:03.934 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2024-03-25T22:57:03.934 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2024-03-25T22:57:03.997 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2024-03-25T22:57:03.998 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-03-25T22:57:04.115 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2024-03-25T22:57:04.150 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2024-03-25T22:57:04.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2024-03-25T22:57:04.293 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-03-25T22:57:04.362 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-03-25T22:57:04.420 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T22:57:04.421 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T22:57:04.422 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T22:57:04.422 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2024-03-25T22:57:04.422 DEBUG:teuthology.parallel:result is None 2024-03-25T22:57:04.619 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2024-03-25T22:57:04.620 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T22:57:04.641 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2024-03-25T22:57:04.641 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T22:57:04.666 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2024-03-25T22:57:04.666 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T22:57:04.684 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2024-03-25T22:57:04.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-03-25T22:57:04.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:57:04.758 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-03-25T22:57:04.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-03-25T22:57:04.902 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-03-25T22:57:04.962 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-03-25T22:57:04.962 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-03-25T22:57:05.023 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-03-25T22:57:05.023 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2024-03-25T22:57:05.023 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-03-25T22:57:05.023 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-03-25T22:57:05.023 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2024-03-25T22:57:05.023 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2024-03-25T22:57:05.023 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T22:57:05.024 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-03-25T22:57:05.024 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T22:57:05.024 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-03-25T22:57:05.024 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T22:57:05.024 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T22:57:05.024 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T22:57:05.024 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-03-25T22:57:05.050 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2024-03-25T22:57:05.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-03-25T22:57:05.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:57:05.128 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-03-25T22:57:05.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-03-25T22:57:05.198 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-03-25T22:57:05.257 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-03-25T22:57:05.258 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T22:57:05.317 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-03-25T22:57:05.318 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T22:57:05.318 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-03-25T22:57:05.318 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T22:57:05.318 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T22:57:05.318 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T22:57:05.318 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-03-25T22:57:05.341 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2024-03-25T22:57:05.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-03-25T22:57:05.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T22:57:05.416 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-03-25T22:57:05.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-03-25T22:57:05.488 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-03-25T22:57:05.549 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-03-25T22:57:05.549 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-03-25T22:57:05.610 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-03-25T22:57:05.610 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2024-03-25T22:57:05.610 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-03-25T22:57:05.610 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-03-25T22:57:05.610 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T22:57:05.611 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T22:57:05.611 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-03-25T22:57:05.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T22:57:05.734 INFO:teuthology.dispatcher.supervisor:Running job 7621659 2024-03-25T22:57:05.734 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi/7621659 --name yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi/7621659/orig.config.yaml 2024-03-25T22:57:05.737 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi/7621659 2024-03-25T22:57:05.738 INFO:teuthology.dispatcher.supervisor:Job PID: 2462991 2024-03-25T22:57:05.738 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-25T22:59:05.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:01:06.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:03:06.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:05:06.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:07:06.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:09:06.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:11:06.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:13:06.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:15:07.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:17:07.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:19:07.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:21:07.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:23:07.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:25:07.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:27:08.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:29:08.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:31:08.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:33:08.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:35:08.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:37:08.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:37:09.061 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1