2023-12-13T17:54:24.357 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-13T17:54:24.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T17:54:24.511 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f24aeb2b580>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f24afa83940>, signals=[15])
2023-12-13T17:54:24.511 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging
2023-12-13T17:54:24.511 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T17:54:24.512 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-12-13T17:54:24.534 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2023-12-13T17:54:24.535 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T17:54:24.535 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-13T17:54:24.659 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_8.stream (ID 3)
2023-12-13T17:54:24.678 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_8.stream (ID 3)
2023-12-13T17:54:24.709 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 8.stream
2023-12-13T17:54:24.737 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.stream
2023-12-13T17:54:24.991 INFO:teuthology.orchestra.console.smithi148:Power off
2023-12-13T17:54:24.991 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T17:54:25.005 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-13T17:54:25.005 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T17:54:25.013 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-12-13T17:54:25.014 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T17:54:25.026 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-13T17:54:25.026 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T17:54:25.033 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-12-13T17:54:25.047 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-13T17:54:25.135 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-12-13T17:54:25.148 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-13T17:54:25.236 INFO:teuthology.orchestra.console.smithi148:Power on
2023-12-13T17:54:25.236 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T17:54:25.249 INFO:teuthology.orchestra.console.smithi150:Power on
2023-12-13T17:54:25.249 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T17:54:25.259 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On
2023-12-13T17:54:25.259 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T17:54:25.270 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2023-12-13T17:54:25.270 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T17:54:25.283 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-12-13T17:54:25.293 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-13T17:54:29.286 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T17:54:29.295 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T17:54:29.395 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-12-13T17:54:29.403 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-13T17:54:29.496 INFO:teuthology.orchestra.console.smithi148:Power on completed
2023-12-13T17:54:29.597 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2023-12-13T17:54:33.406 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T17:54:33.515 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-12-13T17:54:33.616 INFO:teuthology.orchestra.console.smithi150:Power on completed
2023-12-13T17:54:33.716 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2023-12-13T17:57:15.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:18.758 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-12-13T17:57:19.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:22.758 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:57:24.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:27.810 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-12-13T17:57:28.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:31.846 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:57:33.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:36.870 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-12-13T17:57:37.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:40.930 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:57:42.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:45.954 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-12-13T17:57:46.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:49.986 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:57:51.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:55.010 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-12-13T17:57:55.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:57:59.042 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:58:01.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:58:04.066 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-12-13T17:58:05.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:58:08.102 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:58:10.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:58:13.122 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-12-13T17:58:14.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:58:17.154 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:58:19.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:58:23.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:58:26.210 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-13T17:58:32.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:59:19.177 WARNING:teuthology.provision.fog.smithi148:timed out
2023-12-13T17:59:25.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:59:25.440 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T17:59:25.440 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T17:59:25.681 INFO:teuthology.provision.fog.smithi148:Node is ready
2023-12-13T17:59:25.682 DEBUG:teuthology.orchestra.run.smithi148:> hostname
2023-12-13T17:59:25.701 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2023-12-13T17:59:25.701 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts
2023-12-13T17:59:25.760 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2023-12-13T17:59:25.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-12-13T17:59:25.865 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts
2023-12-13T17:59:25.896 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts
2023-12-13T17:59:25.965 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname
2023-12-13T17:59:26.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-12-13T17:59:26.102 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-12-13T17:59:26.160 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T17:59:26.161 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-13T17:59:26.162 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2023-12-13T17:59:26.163 DEBUG:teuthology.parallel:result is None
2023-12-13T17:59:32.222 WARNING:teuthology.provision.fog.smithi150:timed out
2023-12-13T17:59:38.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:59:38.462 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T17:59:38.462 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T17:59:38.737 INFO:teuthology.provision.fog.smithi150:Node is ready
2023-12-13T17:59:38.737 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2023-12-13T17:59:38.756 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2023-12-13T17:59:38.757 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2023-12-13T17:59:38.817 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2023-12-13T17:59:38.817 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-13T17:59:38.909 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2023-12-13T17:59:38.939 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2023-12-13T17:59:39.009 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2023-12-13T17:59:39.077 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-13T17:59:39.147 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-13T17:59:39.205 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-12-13T17:59:39.206 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-12-13T17:59:39.206 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-12-13T17:59:39.206 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-12-13T17:59:39.206 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-12-13T17:59:39.206 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-12-13T17:59:39.206 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-13T17:59:39.207 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-12-13T17:59:39.207 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-13T17:59:39.210 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-12-13T17:59:39.210 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T17:59:39.210 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T17:59:39.210 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-13T17:59:39.210 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2023-12-13T17:59:39.210 DEBUG:teuthology.parallel:result is None
2023-12-13T17:59:39.392 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com
2023-12-13T17:59:39.393 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T17:59:39.414 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2023-12-13T17:59:39.414 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T17:59:39.432 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server
2023-12-13T17:59:39.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-12-13T17:59:39.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:59:39.503 DEBUG:teuthology.orchestra.run.smithi148:> true
2023-12-13T17:59:39.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-12-13T17:59:39.637 DEBUG:teuthology.orchestra.run.smithi148:> uname -m
2023-12-13T17:59:39.696 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64
2023-12-13T17:59:39.697 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-12-13T17:59:39.755 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream"
2023-12-13T17:59:39.756 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8"
2023-12-13T17:59:39.756 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos"
2023-12-13T17:59:39.756 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora"
2023-12-13T17:59:39.757 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8"
2023-12-13T17:59:39.757 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2023-12-13T17:59:39.757 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-13T17:59:39.757 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-12-13T17:59:39.758 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-13T17:59:39.758 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/"
2023-12-13T17:59:39.758 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T17:59:39.758 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T17:59:39.759 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-13T17:59:39.759 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-12-13T17:59:39.781 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2023-12-13T17:59:39.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-13T17:59:39.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T17:59:39.848 DEBUG:teuthology.orchestra.run.smithi150:> true
2023-12-13T17:59:39.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-13T17:59:39.918 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2023-12-13T17:59:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2023-12-13T17:59:39.977 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-13T17:59:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-12-13T17:59:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-12-13T17:59:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-12-13T17:59:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-12-13T17:59:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-12-13T17:59:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-12-13T17:59:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-13T17:59:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-12-13T17:59:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-13T17:59:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-12-13T17:59:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T17:59:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T17:59:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-13T17:59:40.037 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-13T17:59:40.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T17:59:40.177 INFO:teuthology.dispatcher.supervisor:Running job 7490043
2023-12-13T17:59:40.177 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490043 --name vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490043/orig.config.yaml
2023-12-13T17:59:40.184 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490043
2023-12-13T17:59:40.184 INFO:teuthology.dispatcher.supervisor:Job PID: 1629062
2023-12-13T17:59:40.184 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-13T18:01:40.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:03:40.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:05:40.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:07:40.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:09:40.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:11:41.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:13:41.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:15:41.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:17:41.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:19:41.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:21:41.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:23:42.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:25:42.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:27:42.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:29:42.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:31:42.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:33:42.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:35:43.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:37:43.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:39:43.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:41:43.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:43:43.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T18:43:43.905 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-13T18:43:44.084 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-13T18:43:44.084 INFO:teuthology.nuke:Checking targets against current locks
2023-12-13T18:43:44.129 DEBUG:teuthology.nuke:shortname: smithi148
2023-12-13T18:43:44.130 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T18:43:44.159 DEBUG:teuthology.nuke:shortname: smithi150
2023-12-13T18:43:44.159 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T18:43:44.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 17:54:23.523445', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI+oUHzWjewfyC/ZNymRw/cL58uOKdEI/ZhFjMyyzYn4eLucFfsDPrBpoTxgT7Pj8NQx+IbQJAasBsHyxYd9wbU='}
2023-12-13T18:43:44.186 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 17:54:23.522017', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVL4pfKMzHqMwpqysGyhqwLN8peQTvqGZrN7mG2h6R5yOv8HasvqCIdN7xKlCrbSIN7ZfJeKuqjVZhEU5G/gzM='}
2023-12-13T18:43:44.213 INFO:teuthology.orchestra.console.smithi148:Power off
2023-12-13T18:43:44.213 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T18:43:44.239 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-12-13T18:43:44.240 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T18:43:44.263 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-13T18:43:44.264 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T18:43:44.273 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-12-13T18:43:44.286 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-13T18:43:44.286 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T18:43:44.310 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-13T18:43:44.374 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-12-13T18:43:44.412 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-13T18:43:44.531 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com
2023-12-13T18:43:44.561 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com