2024-03-14T23:27:15.629 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-14T23:27:15.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:27:15.800 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9cf79e3c10>, signals=[15]) 2024-03-14T23:27:15.801 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-03-14T23:27:15.801 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-03-14T23:27:15.801 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-14T23:27:15.821 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2024-03-14T23:27:15.821 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2024-03-14T23:27:15.822 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-14T23:27:15.846 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2024-03-14T23:27:15.846 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2024-03-14T23:27:15.846 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-03-14T23:27:15.919 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2024-03-14T23:27:15.945 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_8.stream (ID 3) 2024-03-14T23:27:15.961 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2024-03-14T23:27:15.982 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3) 2024-03-14T23:27:15.988 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 8.stream 2024-03-14T23:27:16.036 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream 2024-03-14T23:27:16.329 INFO:teuthology.orchestra.console.smithi099:Power off 2024-03-14T23:27:16.329 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-14T23:27:16.350 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-03-14T23:27:16.350 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:16.368 INFO:teuthology.orchestra.console.smithi110:Power off 2024-03-14T23:27:16.368 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-14T23:27:16.378 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-14T23:27:16.388 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-03-14T23:27:16.388 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:16.418 INFO:teuthology.orchestra.console.smithi154:Power off 2024-03-14T23:27:16.418 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-14T23:27:16.431 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-14T23:27:16.444 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-03-14T23:27:16.444 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:16.465 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-03-14T23:27:16.479 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-03-14T23:27:16.532 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-03-14T23:27:16.567 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-03-14T23:27:16.580 INFO:teuthology.orchestra.console.smithi099:Power on 2024-03-14T23:27:16.580 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-14T23:27:16.602 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-03-14T23:27:16.603 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:16.623 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-14T23:27:16.633 INFO:teuthology.orchestra.console.smithi110:Power on 2024-03-14T23:27:16.633 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-14T23:27:16.656 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2024-03-14T23:27:16.657 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:16.668 INFO:teuthology.orchestra.console.smithi154:Power on 2024-03-14T23:27:16.668 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-14T23:27:16.679 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-14T23:27:16.689 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2024-03-14T23:27:16.690 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:16.712 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-03-14T23:27:20.626 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:20.680 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:20.714 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:20.735 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-14T23:27:20.789 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-14T23:27:20.822 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-03-14T23:27:20.836 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-03-14T23:27:20.890 INFO:teuthology.orchestra.console.smithi110:Power on completed 2024-03-14T23:27:20.937 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-03-14T23:27:20.990 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2024-03-14T23:27:24.826 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-14T23:27:24.935 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-03-14T23:27:25.036 INFO:teuthology.orchestra.console.smithi154:Power on completed 2024-03-14T23:27:25.137 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2024-03-14T23:30:41.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:00.255 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-03-14T23:31:06.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:09.342 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-03-14T23:31:15.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:18.430 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-03-14T23:31:23.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:24.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:27.486 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-03-14T23:31:33.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:36.574 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-03-14T23:31:38.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:38.202 ERROR:teuthology.orchestra.connection:Error authenticating with smithi099.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-14T23:31:41.470 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-14T23:31:42.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:47.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:50.530 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-14T23:31:52.478 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-14T23:31:56.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:58.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:31:59.582 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-14T23:32:01.534 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-14T23:32:05.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:07.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:08.642 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-14T23:32:10.590 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-14T23:32:14.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:16.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:17.694 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-14T23:32:19.650 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-14T23:32:23.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:25.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:28.702 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-14T23:32:34.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:37.758 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-14T23:32:42.578 WARNING:teuthology.provision.fog.smithi154:timed out 2024-03-14T23:32:43.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:48.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:32:48.816 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-14T23:32:48.816 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-14T23:32:49.084 INFO:teuthology.provision.fog.smithi154:Node is ready 2024-03-14T23:32:49.084 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2024-03-14T23:32:49.103 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2024-03-14T23:32:49.104 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2024-03-14T23:32:49.163 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2024-03-14T23:32:49.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-03-14T23:32:49.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2024-03-14T23:32:49.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2024-03-14T23:32:49.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2024-03-14T23:32:49.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-03-14T23:32:49.505 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-03-14T23:32:49.563 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-03-14T23:32:49.563 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2024-03-14T23:32:49.563 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-03-14T23:32:49.563 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-14T23:32:49.564 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-14T23:32:49.566 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2024-03-14T23:32:49.567 DEBUG:teuthology.parallel:result is None 2024-03-14T23:33:15.468 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-14T23:33:15.480 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-14T23:33:23.697 WARNING:teuthology.provision.fog.smithi110:timed out 2024-03-14T23:33:29.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:33:30.042 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-14T23:33:30.043 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-14T23:33:30.311 INFO:teuthology.provision.fog.smithi110:Node is ready 2024-03-14T23:33:30.311 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2024-03-14T23:33:30.330 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2024-03-14T23:33:30.331 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2024-03-14T23:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2024-03-14T23:33:30.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-03-14T23:33:30.485 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2024-03-14T23:33:30.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2024-03-14T23:33:30.586 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2024-03-14T23:33:30.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-03-14T23:33:30.723 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-14T23:33:30.781 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-14T23:33:30.781 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-14T23:33:30.782 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-14T23:33:30.783 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2024-03-14T23:33:30.784 DEBUG:teuthology.parallel:result is None 2024-03-14T23:33:40.639 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-03-14T23:33:40.639 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-03-14T23:33:40.663 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-03-14T23:33:40.663 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-03-14T23:33:40.724 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-03-14T23:33:40.724 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-03-14T23:33:40.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-03-14T23:33:40.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-03-14T23:33:40.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-03-14T23:33:41.024 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-03-14T23:33:41.092 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-14T23:33:41.150 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-14T23:33:41.150 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-03-14T23:33:41.150 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-14T23:33:41.150 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-14T23:33:41.150 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-14T23:33:41.151 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-14T23:33:41.151 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-03-14T23:33:41.152 DEBUG:teuthology.parallel:result is None 2024-03-14T23:33:41.340 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-03-14T23:33:41.340 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-14T23:33:41.363 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2024-03-14T23:33:41.363 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-14T23:33:41.388 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2024-03-14T23:33:41.388 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-14T23:33:41.414 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-03-14T23:33:41.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-14T23:33:41.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:33:41.483 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-14T23:33:41.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-14T23:33:41.548 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-03-14T23:33:41.606 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-03-14T23:33:41.606 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-14T23:33:41.663 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-14T23:33:41.663 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-14T23:33:41.664 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-14T23:33:41.665 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-14T23:33:41.688 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2024-03-14T23:33:41.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-14T23:33:41.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:33:41.759 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-03-14T23:33:41.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-14T23:33:41.888 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-03-14T23:33:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-03-14T23:33:41.947 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-14T23:33:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-14T23:33:42.007 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-14T23:33:42.007 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-14T23:33:42.007 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-14T23:33:42.007 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-14T23:33:42.038 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2024-03-14T23:33:42.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-03-14T23:33:42.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-14T23:33:42.109 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-03-14T23:33:42.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-03-14T23:33:42.245 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-03-14T23:33:42.305 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-03-14T23:33:42.305 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-03-14T23:33:42.363 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-14T23:33:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-14T23:33:42.365 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-03-14T23:33:42.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:33:42.487 INFO:teuthology.dispatcher.supervisor:Running job 7600536 2024-03-14T23:33:42.487 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-14_15:32:07-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi/7600536 --name yuriw-2024-03-14_15:32:07-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/yuriw-2024-03-14_15:32:07-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi/7600536/orig.config.yaml 2024-03-14T23:33:42.490 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-14_15:32:07-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi/7600536 2024-03-14T23:33:42.490 INFO:teuthology.dispatcher.supervisor:Job PID: 2894477 2024-03-14T23:33:42.490 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-14T23:35:42.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:37:42.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:39:42.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:41:42.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:43:42.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:45:42.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:47:42.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:49:42.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:51:43.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:53:43.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:55:43.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:57:43.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-14T23:59:43.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:01:43.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:03:43.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:05:43.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:07:43.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:09:43.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:11:43.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:13:43.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:15:43.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:17:44.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:19:44.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:21:44.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:23:44.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:25:44.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:27:44.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:29:44.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:31:44.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:33:44.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:35:44.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:37:44.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:39:44.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:41:44.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:43:44.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:45:45.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:47:45.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:49:45.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:51:45.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:53:45.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:55:45.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:57:45.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T00:59:45.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T01:01:45.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T01:03:45.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T01:05:45.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-15T01:05:45.855 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1