2024-04-12T04:55:53.844 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-12T04:55:53.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T04:55:54.008 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa044c78c10>, signals=[15]) 2024-04-12T04:55:54.008 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2024-04-12T04:55:54.008 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2024-04-12T04:55:54.008 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-04-12T04:55:54.039 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2024-04-12T04:55:54.040 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2024-04-12T04:55:54.040 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-12T04:55:54.196 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_8.stream (ID 3) 2024-04-12T04:55:54.239 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3) 2024-04-12T04:55:54.254 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream 2024-04-12T04:55:54.292 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream 2024-04-12T04:55:54.557 INFO:teuthology.orchestra.console.smithi003:Power off 2024-04-12T04:55:54.557 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T04:55:54.608 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2024-04-12T04:55:54.608 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:55:54.622 INFO:teuthology.orchestra.console.smithi038:Power off 2024-04-12T04:55:54.622 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T04:55:54.658 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-04-12T04:55:54.669 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-04-12T04:55:54.669 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:55:54.732 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-12T04:55:58.663 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:55:58.733 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:55:58.771 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-04-12T04:55:58.840 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-12T04:56:02.777 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:02.841 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:02.886 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-04-12T04:56:02.951 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-12T04:56:03.051 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-04-12T04:56:03.152 INFO:teuthology.orchestra.console.smithi038:Power on 2024-04-12T04:56:03.152 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-12T04:56:03.182 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2024-04-12T04:56:03.183 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:03.213 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-12T04:56:06.890 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:06.998 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-04-12T04:56:07.099 INFO:teuthology.orchestra.console.smithi003:Power off completed 2024-04-12T04:56:07.200 INFO:teuthology.orchestra.console.smithi003:Power on 2024-04-12T04:56:07.200 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-12T04:56:07.214 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:07.251 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2024-04-12T04:56:07.251 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:07.280 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-04-12T04:56:07.323 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-12T04:56:11.285 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:11.323 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:11.394 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-04-12T04:56:11.431 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-12T04:56:11.531 INFO:teuthology.orchestra.console.smithi038:Power on completed 2024-04-12T04:56:11.633 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2024-04-12T04:56:15.395 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T04:56:15.504 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-04-12T04:56:15.605 INFO:teuthology.orchestra.console.smithi003:Power on completed 2024-04-12T04:56:15.705 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2024-04-12T04:58:42.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:58:42.561 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-12T04:58:46.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:58:49.502 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-04-12T04:58:55.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:58:58.594 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-04-12T04:59:04.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:59:07.678 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-04-12T04:59:13.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:59:16.766 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-04-12T04:59:22.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:59:25.854 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-04-12T04:59:31.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:59:34.950 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-04-12T04:59:40.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:59:46.587 WARNING:teuthology.provision.fog.smithi038:timed out 2024-04-12T04:59:52.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T04:59:55.678 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-12T05:00:01.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T05:00:04.766 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-12T05:00:10.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T05:00:13.854 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-12T05:00:19.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T05:00:20.046 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-12T05:00:20.047 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-12T05:00:35.263 INFO:teuthology.provision.fog.smithi038:Node is ready 2024-04-12T05:00:35.263 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2024-04-12T05:00:35.288 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2024-04-12T05:00:35.288 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2024-04-12T05:00:35.351 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2024-04-12T05:00:35.351 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-04-12T05:00:35.485 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2024-04-12T05:00:35.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2024-04-12T05:00:35.590 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2024-04-12T05:00:35.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-04-12T05:00:35.732 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-12T05:00:35.793 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-04-12T05:00:35.793 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2024-04-12T05:00:35.793 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-04-12T05:00:35.793 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-04-12T05:00:35.793 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-12T05:00:35.794 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T05:00:35.795 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2024-04-12T05:00:35.796 DEBUG:teuthology.parallel:result is None 2024-04-12T05:00:40.980 WARNING:teuthology.provision.fog.smithi003:timed out 2024-04-12T05:00:46.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T05:00:47.282 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-12T05:00:47.282 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-12T05:00:47.551 INFO:teuthology.provision.fog.smithi003:Node is ready 2024-04-12T05:00:47.551 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2024-04-12T05:00:47.570 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2024-04-12T05:00:47.571 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2024-04-12T05:00:47.631 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2024-04-12T05:00:47.631 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-04-12T05:00:47.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2024-04-12T05:00:47.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2024-04-12T05:00:47.841 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2024-04-12T05:00:47.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-04-12T05:00:47.980 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-04-12T05:00:48.039 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-04-12T05:00:48.039 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2024-04-12T05:00:48.039 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-12T05:00:48.040 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T05:00:48.041 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2024-04-12T05:00:48.041 DEBUG:teuthology.parallel:result is None 2024-04-12T05:00:48.374 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2024-04-12T05:00:48.374 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-12T05:00:48.409 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2024-04-12T05:00:48.410 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-12T05:00:48.435 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2024-04-12T05:00:48.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-04-12T05:00:48.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T05:00:48.523 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-04-12T05:00:48.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-04-12T05:00:48.551 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-04-12T05:00:48.611 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-04-12T05:00:48.612 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-04-12T05:00:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T05:00:48.673 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-12T05:00:48.673 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T05:00:48.673 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-04-12T05:00:48.702 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2024-04-12T05:00:48.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-12T05:00:48.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T05:00:48.785 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-04-12T05:00:48.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-12T05:00:48.926 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-04-12T05:00:48.986 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-04-12T05:00:48.986 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-12T05:00:49.045 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-04-12T05:00:49.045 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-12T05:00:49.046 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T05:00:49.047 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-12T05:00:49.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:00:49.178 INFO:teuthology.dispatcher.supervisor:Running job 7652634 2024-04-12T05:00:49.178 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-11_20:32:36-orch-reef-release-distro-default-smithi/7652634 --name yuriw-2024-04-11_20:32:36-orch-reef-release-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2024-04-11_20:32:36-orch-reef-release-distro-default-smithi/7652634/orig.config.yaml 2024-04-12T05:00:49.181 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-11_20:32:36-orch-reef-release-distro-default-smithi/7652634 2024-04-12T05:00:49.181 INFO:teuthology.dispatcher.supervisor:Job PID: 980835 2024-04-12T05:00:49.181 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-12T05:02:49.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:04:49.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:06:49.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:08:49.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:10:49.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:12:49.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:14:49.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:16:49.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:18:49.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:20:49.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:22:50.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:24:50.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:26:50.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:28:50.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:30:50.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:32:50.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:34:50.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:36:50.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:38:50.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:40:50.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:42:50.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:44:50.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:46:50.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T05:46:51.012 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1