2024-01-21T05:39:00.835 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-21T05:39:00.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:39:01.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa0ad673c10>, signals=[15]) 2024-01-21T05:39:01.008 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2024-01-21T05:39:01.008 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2024-01-21T05:39:01.008 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-01-21T05:39:01.028 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2024-01-21T05:39:01.028 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2024-01-21T05:39:01.028 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-01-21T05:39:01.053 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2024-01-21T05:39:01.053 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2024-01-21T05:39:01.053 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-01-21T05:39:01.141 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_8.stream (ID 3) 2024-01-21T05:39:01.179 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_8.stream (ID 3) 2024-01-21T05:39:01.188 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_8.stream (ID 3) 2024-01-21T05:39:01.201 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 8.stream 2024-01-21T05:39:01.216 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.stream 2024-01-21T05:39:01.231 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.stream 2024-01-21T05:39:01.445 INFO:teuthology.orchestra.console.smithi071:Power off 2024-01-21T05:39:01.445 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T05:39:01.460 INFO:teuthology.orchestra.console.smithi170:Power off 2024-01-21T05:39:01.460 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T05:39:01.472 INFO:teuthology.orchestra.console.smithi033:Power off 2024-01-21T05:39:01.472 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T05:39:01.480 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-01-21T05:39:01.480 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:01.489 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-01-21T05:39:01.489 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:01.498 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-01-21T05:39:01.498 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:01.506 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-01-21T05:39:01.512 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-01-21T05:39:01.519 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-21T05:39:01.612 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-01-21T05:39:01.713 INFO:teuthology.orchestra.console.smithi170:Power on 2024-01-21T05:39:01.713 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-21T05:39:01.735 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2024-01-21T05:39:01.735 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:01.755 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-01-21T05:39:05.511 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:05.520 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:05.620 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-01-21T05:39:05.629 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-21T05:39:05.756 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:05.865 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-01-21T05:39:09.624 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:09.632 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:09.734 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-01-21T05:39:09.741 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-21T05:39:09.866 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:09.975 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-01-21T05:39:10.076 INFO:teuthology.orchestra.console.smithi170:Power on completed 2024-01-21T05:39:10.176 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2024-01-21T05:39:13.737 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:13.744 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:13.846 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-01-21T05:39:13.852 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-21T05:39:13.948 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-01-21T05:39:13.953 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-01-21T05:39:14.048 INFO:teuthology.orchestra.console.smithi071:Power on 2024-01-21T05:39:14.049 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-21T05:39:14.056 INFO:teuthology.orchestra.console.smithi033:Power on 2024-01-21T05:39:14.056 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-21T05:39:14.070 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2024-01-21T05:39:14.070 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:14.078 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2024-01-21T05:39:14.079 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:14.091 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-01-21T05:39:14.099 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-21T05:39:18.097 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:18.104 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:18.205 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-01-21T05:39:18.215 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-21T05:39:18.316 INFO:teuthology.orchestra.console.smithi033:Power on completed 2024-01-21T05:39:18.416 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2024-01-21T05:39:22.210 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T05:39:22.319 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-01-21T05:39:22.420 INFO:teuthology.orchestra.console.smithi071:Power on completed 2024-01-21T05:39:22.520 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2024-01-21T05:41:49.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:41:56.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:07.676 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-21T05:42:08.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:13.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:14.588 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-01-21T05:42:16.764 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-21T05:42:20.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:22.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:23.644 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-01-21T05:42:25.820 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-21T05:42:26.876 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-01-21T05:42:29.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:31.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:32.700 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-01-21T05:42:32.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:35.932 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-01-21T05:42:38.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:41.756 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-01-21T05:42:41.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:44.988 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-01-21T05:42:47.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:50.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:42:54.076 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-01-21T05:43:00.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:43:03.168 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-01-21T05:43:09.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:43:31.834 WARNING:teuthology.provision.fog.smithi033:timed out 2024-01-21T05:43:37.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:43:38.064 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-21T05:43:38.064 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-21T05:43:38.348 INFO:teuthology.provision.fog.smithi033:Node is ready 2024-01-21T05:43:38.349 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2024-01-21T05:43:38.370 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2024-01-21T05:43:38.370 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2024-01-21T05:43:38.433 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2024-01-21T05:43:38.434 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-01-21T05:43:38.546 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2024-01-21T05:43:38.583 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2024-01-21T05:43:38.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2024-01-21T05:43:38.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-01-21T05:43:38.796 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-01-21T05:43:38.856 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-01-21T05:43:38.856 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2024-01-21T05:43:38.856 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-01-21T05:43:38.857 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T05:43:38.858 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T05:43:38.858 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T05:43:38.859 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2024-01-21T05:43:38.861 DEBUG:teuthology.parallel:result is None 2024-01-21T05:43:47.768 WARNING:teuthology.provision.fog.smithi170:timed out 2024-01-21T05:43:53.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:43:54.017 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-21T05:43:54.018 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-21T05:43:54.285 INFO:teuthology.provision.fog.smithi170:Node is ready 2024-01-21T05:43:54.285 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2024-01-21T05:43:54.304 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2024-01-21T05:43:54.304 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2024-01-21T05:43:54.364 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2024-01-21T05:43:54.364 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-01-21T05:43:54.464 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2024-01-21T05:43:54.494 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2024-01-21T05:43:54.562 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2024-01-21T05:43:54.629 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-01-21T05:43:54.696 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-01-21T05:43:54.754 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-01-21T05:43:54.754 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8" 2024-01-21T05:43:54.754 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T05:43:54.755 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T05:43:54.755 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2024-01-21T05:43:54.756 DEBUG:teuthology.parallel:result is None 2024-01-21T05:44:09.190 WARNING:teuthology.provision.fog.smithi071:timed out 2024-01-21T05:44:15.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:44:15.473 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-21T05:44:15.474 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-21T05:44:15.732 INFO:teuthology.provision.fog.smithi071:Node is ready 2024-01-21T05:44:15.732 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2024-01-21T05:44:15.752 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2024-01-21T05:44:15.753 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2024-01-21T05:44:15.813 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2024-01-21T05:44:15.814 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-01-21T05:44:15.909 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2024-01-21T05:44:15.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2024-01-21T05:44:16.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2024-01-21T05:44:16.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-01-21T05:44:16.147 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-01-21T05:44:16.206 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-01-21T05:44:16.206 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2024-01-21T05:44:16.206 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-01-21T05:44:16.206 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-01-21T05:44:16.206 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2024-01-21T05:44:16.206 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2024-01-21T05:44:16.207 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T05:44:16.207 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-01-21T05:44:16.207 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T05:44:16.207 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-01-21T05:44:16.207 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T05:44:16.207 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T05:44:16.207 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T05:44:16.207 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2024-01-21T05:44:16.208 DEBUG:teuthology.parallel:result is None 2024-01-21T05:44:16.393 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2024-01-21T05:44:16.393 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-21T05:44:16.423 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2024-01-21T05:44:16.423 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-21T05:44:16.448 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2024-01-21T05:44:16.448 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-21T05:44:16.466 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2024-01-21T05:44:16.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-01-21T05:44:16.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:44:16.547 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-01-21T05:44:16.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-01-21T05:44:16.688 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-01-21T05:44:16.748 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-01-21T05:44:16.749 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-01-21T05:44:16.808 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-01-21T05:44:16.808 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2024-01-21T05:44:16.808 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-01-21T05:44:16.808 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-01-21T05:44:16.808 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2024-01-21T05:44:16.808 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2024-01-21T05:44:16.809 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T05:44:16.809 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-01-21T05:44:16.809 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T05:44:16.809 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-01-21T05:44:16.809 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T05:44:16.809 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T05:44:16.809 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T05:44:16.809 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-01-21T05:44:16.831 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2024-01-21T05:44:16.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-01-21T05:44:16.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:44:16.905 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-01-21T05:44:16.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-01-21T05:44:16.977 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-01-21T05:44:17.037 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-01-21T05:44:17.037 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-01-21T05:44:17.097 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T05:44:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T05:44:17.099 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-01-21T05:44:17.123 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2024-01-21T05:44:17.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-01-21T05:44:17.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T05:44:17.196 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-01-21T05:44:17.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-01-21T05:44:17.327 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-01-21T05:44:17.385 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-01-21T05:44:17.385 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-01-21T05:44:17.443 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-01-21T05:44:17.443 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8" 2024-01-21T05:44:17.443 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-01-21T05:44:17.443 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T05:44:17.444 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T05:44:17.444 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-01-21T05:44:17.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:44:17.558 INFO:teuthology.dispatcher.supervisor:Running job 7524125 2024-01-21T05:44:17.558 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524125 --name yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi --description rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} -- /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524125/orig.config.yaml 2024-01-21T05:44:17.561 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524125 2024-01-21T05:44:17.562 INFO:teuthology.dispatcher.supervisor:Job PID: 1776520 2024-01-21T05:44:17.562 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-21T05:46:17.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:48:17.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:50:17.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:52:18.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:54:18.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:56:18.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T05:58:18.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T06:00:18.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T06:00:18.848 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-21T06:00:18.963 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-21T06:00:18.964 INFO:teuthology.nuke:Checking targets against current locks 2024-01-21T06:00:19.010 DEBUG:teuthology.nuke:shortname: smithi033 2024-01-21T06:00:19.010 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T06:00:19.033 DEBUG:teuthology.nuke:shortname: smithi071 2024-01-21T06:00:19.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T06:00:19.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 05:38:59.762809', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBMPjyEFlnSOdZQrnRQo66Gn8JTKhSmtxmVEimHwntk3bI8VRdJCkBIb7rY/ph87CfOxbXIRYb3QcXOnBkVB230='} 2024-01-21T06:00:19.058 DEBUG:teuthology.nuke:shortname: smithi170 2024-01-21T06:00:19.058 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T06:00:19.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 05:38:59.764425', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFduuuRFILQtZXEf38uJgs3EKoVT7TjJG1YKZBWo1d7LwsU1LyPXr617zMNPSU6PyanhG+eLMaPvqZsGeLHf95c='} 2024-01-21T06:00:19.088 INFO:teuthology.orchestra.console.smithi033:Power off 2024-01-21T06:00:19.088 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T06:00:19.098 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 05:38:59.765351', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAgKO6sMJDDo2LETGg8HUciyLd3M8xDVwsDSf1Qlubvs8EyH2QCurjLd2+Pz4x4coInMqTM7KHlLQE0k3QD2rHs='} 2024-01-21T06:00:19.110 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-01-21T06:00:19.110 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T06:00:19.122 INFO:teuthology.orchestra.console.smithi071:Power off 2024-01-21T06:00:19.122 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T06:00:19.132 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-21T06:00:19.142 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-01-21T06:00:19.142 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T06:00:19.153 INFO:teuthology.orchestra.console.smithi170:Power off 2024-01-21T06:00:19.154 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T06:00:19.162 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-01-21T06:00:19.175 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-01-21T06:00:19.176 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T06:00:19.196 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-01-21T06:00:19.233 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-01-21T06:00:19.263 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-01-21T06:00:19.298 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-01-21T06:00:19.381 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2024-01-21T06:00:19.406 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2024-01-21T06:00:19.439 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com