2024-04-06T15:55:15.660 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-06T15:55:15.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T15:55:15.835 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f44b1b08c10>, signals=[15]) 2024-04-06T15:55:15.835 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2024-04-06T15:55:15.835 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2024-04-06T15:55:15.835 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-06T15:55:15.858 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2024-04-06T15:55:15.859 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2024-04-06T15:55:15.859 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-04-06T15:55:15.883 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2024-04-06T15:55:15.883 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2024-04-06T15:55:15.883 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-04-06T15:55:15.974 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_centos_8.stream (ID 3) 2024-04-06T15:55:15.985 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_8.stream (ID 3) 2024-04-06T15:55:16.016 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 8.stream 2024-04-06T15:55:16.019 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_8.stream (ID 3) 2024-04-06T15:55:16.025 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream 2024-04-06T15:55:16.070 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2024-04-06T15:55:16.282 INFO:teuthology.orchestra.console.smithi122:Power off 2024-04-06T15:55:16.282 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-06T15:55:16.295 INFO:teuthology.orchestra.console.smithi162:Power off 2024-04-06T15:55:16.295 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-06T15:55:16.308 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2024-04-06T15:55:16.308 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:16.318 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-04-06T15:55:16.318 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:16.331 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2024-04-06T15:55:16.338 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-04-06T15:55:16.346 INFO:teuthology.orchestra.console.smithi181:Power off 2024-04-06T15:55:16.347 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-06T15:55:16.369 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-04-06T15:55:16.370 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:16.398 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-06T15:55:16.439 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-04-06T15:55:16.540 INFO:teuthology.orchestra.console.smithi162:Power on 2024-04-06T15:55:16.540 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-06T15:55:16.561 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2024-04-06T15:55:16.561 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:16.581 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-04-06T15:55:20.334 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:20.400 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:20.444 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2024-04-06T15:55:20.509 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-06T15:55:20.582 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:20.691 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-04-06T15:55:20.792 INFO:teuthology.orchestra.console.smithi162:Power on completed 2024-04-06T15:55:20.893 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2024-04-06T15:55:24.445 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:24.510 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:24.554 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-06T15:55:24.622 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-06T15:55:24.656 INFO:teuthology.orchestra.console.smithi122:Power off completed 2024-04-06T15:55:24.756 INFO:teuthology.orchestra.console.smithi122:Power on 2024-04-06T15:55:24.757 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-06T15:55:24.780 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On 2024-04-06T15:55:24.781 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:24.801 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-06T15:55:28.626 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:28.736 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-04-06T15:55:28.801 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:28.837 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-04-06T15:55:28.912 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-06T15:55:28.937 INFO:teuthology.orchestra.console.smithi181:Power on 2024-04-06T15:55:28.937 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-06T15:55:28.959 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2024-04-06T15:55:28.959 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:28.980 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-04-06T15:55:32.915 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:32.980 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T15:55:33.025 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2024-04-06T15:55:33.089 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-06T15:55:33.126 INFO:teuthology.orchestra.console.smithi122:Power on completed 2024-04-06T15:55:33.190 INFO:teuthology.orchestra.console.smithi181:Power on completed 2024-04-06T15:55:33.227 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2024-04-06T15:55:33.290 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2024-04-06T15:58:06.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:07.124 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-06T15:58:19.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:19.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:22.306 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:58:22.307 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-06T15:58:28.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:28.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:31.358 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:58:31.394 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-06T15:58:37.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:37.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:40.414 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:58:40.450 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-06T15:58:46.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:46.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:49.470 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:58:49.502 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-06T15:58:55.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:55.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:58:58.526 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:58:58.558 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-06T15:59:04.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:04.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:07.582 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:59:07.614 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-06T15:59:11.126 WARNING:teuthology.provision.fog.smithi162:timed out 2024-04-06T15:59:13.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:13.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:16.674 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-06T15:59:17.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:22.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:32.126 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:59:38.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:41.182 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-06T15:59:47.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T15:59:48.649 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-06T15:59:48.649 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-06T15:59:54.374 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-06T15:59:54.374 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-06T16:00:13.734 INFO:teuthology.provision.fog.smithi181:Node is ready 2024-04-06T16:00:13.735 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2024-04-06T16:00:13.758 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2024-04-06T16:00:13.759 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2024-04-06T16:00:13.819 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2024-04-06T16:00:13.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-04-06T16:00:13.941 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2024-04-06T16:00:13.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2024-04-06T16:00:14.041 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2024-04-06T16:00:14.111 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-04-06T16:00:14.178 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-04-06T16:00:14.235 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T16:00:14.236 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T16:00:14.237 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T16:00:14.237 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2024-04-06T16:00:14.239 DEBUG:teuthology.parallel:result is None 2024-04-06T16:00:17.130 WARNING:teuthology.provision.fog.smithi162:timed out 2024-04-06T16:00:19.196 INFO:teuthology.provision.fog.smithi122:Node is ready 2024-04-06T16:00:19.196 DEBUG:teuthology.orchestra.run.smithi122:> hostname 2024-04-06T16:00:19.220 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2024-04-06T16:00:19.221 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts 2024-04-06T16:00:19.283 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2024-04-06T16:00:19.283 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-06T16:00:19.427 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts 2024-04-06T16:00:19.463 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts 2024-04-06T16:00:19.537 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname 2024-04-06T16:00:19.611 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-06T16:00:19.682 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-06T16:00:19.743 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T16:00:19.744 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T16:00:19.744 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T16:00:19.744 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2024-04-06T16:00:19.744 DEBUG:teuthology.parallel:result is None 2024-04-06T16:00:23.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T16:00:23.342 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-06T16:00:23.343 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-06T16:00:23.586 INFO:teuthology.provision.fog.smithi162:Node is ready 2024-04-06T16:00:23.587 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2024-04-06T16:00:23.646 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2024-04-06T16:00:23.647 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2024-04-06T16:00:23.707 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2024-04-06T16:00:23.707 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-04-06T16:00:23.805 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2024-04-06T16:00:23.835 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2024-04-06T16:00:23.904 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2024-04-06T16:00:23.974 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-04-06T16:00:24.041 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-04-06T16:00:24.100 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T16:00:24.101 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T16:00:24.101 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T16:00:24.101 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2024-04-06T16:00:24.101 DEBUG:teuthology.parallel:result is None 2024-04-06T16:00:24.293 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2024-04-06T16:00:24.294 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-06T16:00:24.320 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2024-04-06T16:00:24.320 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-06T16:00:24.337 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2024-04-06T16:00:24.337 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-06T16:00:24.355 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2024-04-06T16:00:24.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-06T16:00:24.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T16:00:24.428 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-06T16:00:24.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-06T16:00:24.504 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-06T16:00:24.566 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-06T16:00:24.566 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T16:00:24.628 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-06T16:00:24.629 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T16:00:24.629 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T16:00:24.629 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T16:00:24.629 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-06T16:00:24.654 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2024-04-06T16:00:24.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-06T16:00:24.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T16:00:24.728 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-04-06T16:00:24.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-06T16:00:24.802 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-04-06T16:00:24.861 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-04-06T16:00:24.862 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T16:00:24.921 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-04-06T16:00:24.922 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T16:00:24.922 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-04-06T16:00:24.922 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T16:00:24.922 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T16:00:24.922 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T16:00:24.923 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-04-06T16:00:24.945 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2024-04-06T16:00:24.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-06T16:00:24.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T16:00:25.025 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-04-06T16:00:25.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-06T16:00:25.161 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-04-06T16:00:25.221 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-04-06T16:00:25.221 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T16:00:25.280 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-04-06T16:00:25.281 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T16:00:25.281 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-04-06T16:00:25.281 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T16:00:25.281 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T16:00:25.281 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T16:00:25.281 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-04-06T16:00:25.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:00:25.420 INFO:teuthology.dispatcher.supervisor:Running job 7642462 2024-04-06T16:00:25.420 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi/7642462 --name yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi/7642462/orig.config.yaml 2024-04-06T16:00:25.424 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi/7642462 2024-04-06T16:00:25.424 INFO:teuthology.dispatcher.supervisor:Job PID: 3648458 2024-04-06T16:00:25.424 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-06T16:02:25.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:04:25.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:06:25.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:08:25.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:10:25.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:12:25.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:14:25.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:16:25.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:18:26.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:20:26.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:22:26.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:24:26.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:26:26.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:28:26.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:30:26.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:32:26.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:34:26.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:36:26.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:38:26.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:40:26.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:42:26.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:44:26.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:46:27.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:48:27.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:50:27.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:52:27.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:54:27.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:56:27.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T16:58:27.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:00:27.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:02:27.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:04:27.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:06:27.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:08:27.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:10:27.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:12:28.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:14:28.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:16:28.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:18:28.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:20:28.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:22:28.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:24:28.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:26:28.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:28:28.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:30:28.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:32:28.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:34:28.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:36:28.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:38:29.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:40:29.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:42:29.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:44:29.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T17:44:29.331 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1