2023-12-19T18:40:09.074 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T18:40:09.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:40:09.215 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f25017c75b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f250271d940>, signals=[15])
2023-12-19T18:40:09.215 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging
2023-12-19T18:40:09.215 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T18:40:09.215 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2023-12-19T18:40:09.237 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2023-12-19T18:40:09.237 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T18:40:09.237 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2023-12-19T18:40:09.353 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10)
2023-12-19T18:40:09.377 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_9.stream (ID 10)
2023-12-19T18:40:09.396 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream
2023-12-19T18:40:09.422 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 9.stream
2023-12-19T18:40:09.684 INFO:teuthology.orchestra.console.smithi012:Power off
2023-12-19T18:40:09.685 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:40:09.698 INFO:teuthology.orchestra.console.smithi100:Power off
2023-12-19T18:40:09.699 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:40:09.706 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off
2023-12-19T18:40:09.707 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:09.719 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2023-12-19T18:40:09.719 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:09.727 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2023-12-19T18:40:09.740 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2023-12-19T18:40:13.731 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:13.741 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:13.841 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2023-12-19T18:40:13.849 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2023-12-19T18:40:17.845 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:17.852 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:17.954 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2023-12-19T18:40:17.962 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2023-12-19T18:40:18.063 INFO:teuthology.orchestra.console.smithi100:Power off completed
2023-12-19T18:40:18.163 INFO:teuthology.orchestra.console.smithi100:Power on
2023-12-19T18:40:18.164 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T18:40:18.185 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2023-12-19T18:40:18.185 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:18.209 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2023-12-19T18:40:21.957 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:22.067 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2023-12-19T18:40:22.168 INFO:teuthology.orchestra.console.smithi012:Power off completed
2023-12-19T18:40:22.211 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:22.269 INFO:teuthology.orchestra.console.smithi012:Power on
2023-12-19T18:40:22.269 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T18:40:22.294 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On
2023-12-19T18:40:22.294 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:22.320 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2023-12-19T18:40:22.322 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2023-12-19T18:40:22.421 INFO:teuthology.orchestra.console.smithi100:Power on completed
2023-12-19T18:40:22.522 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2023-12-19T18:40:26.325 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:26.434 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2023-12-19T18:40:26.535 INFO:teuthology.orchestra.console.smithi012:Power on completed
2023-12-19T18:40:26.636 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2023-12-19T18:42:42.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:42:42.628 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-19T18:43:08.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:11.761 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-12-19T18:43:17.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:20.821 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-12-19T18:43:26.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:29.873 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-12-19T18:43:35.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:38.929 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-12-19T18:43:44.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:46.631 WARNING:teuthology.provision.fog.smithi012:timed out
2023-12-19T18:43:47.985 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-12-19T18:43:52.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:53.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:57.045 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-12-19T18:44:03.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:44:10.209 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T18:44:10.209 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T18:44:30.245 INFO:teuthology.provision.fog.smithi012:Node is ready
2023-12-19T18:44:30.248 DEBUG:teuthology.orchestra.run.smithi012:> hostname
2023-12-19T18:44:30.268 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2023-12-19T18:44:30.268 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts
2023-12-19T18:44:30.326 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2023-12-19T18:44:30.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2023-12-19T18:44:30.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts
2023-12-19T18:44:30.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts
2023-12-19T18:44:30.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname
2023-12-19T18:44:30.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2023-12-19T18:44:30.706 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-19T18:44:30.762 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2023-12-19T18:44:30.763 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2023-12-19T18:44:30.763 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-19T18:44:30.763 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2023-12-19T18:44:30.763 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:44:30.763 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-19T18:44:30.763 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T18:44:30.764 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2023-12-19T18:44:30.765 DEBUG:teuthology.parallel:result is None
2023-12-19T18:45:03.049 WARNING:teuthology.provision.fog.smithi100:timed out
2023-12-19T18:45:09.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:09.357 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T18:45:09.357 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T18:45:09.686 INFO:teuthology.provision.fog.smithi100:Node is ready
2023-12-19T18:45:09.687 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2023-12-19T18:45:09.702 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2023-12-19T18:45:09.702 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts
2023-12-19T18:45:09.758 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2023-12-19T18:45:09.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2023-12-19T18:45:09.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts
2023-12-19T18:45:09.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2023-12-19T18:45:09.964 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname
2023-12-19T18:45:10.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2023-12-19T18:45:10.098 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2023-12-19T18:45:10.151 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2023-12-19T18:45:10.151 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-19T18:45:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T18:45:10.153 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2023-12-19T18:45:10.153 DEBUG:teuthology.parallel:result is None
2023-12-19T18:45:10.322 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2023-12-19T18:45:10.322 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T18:45:10.346 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2023-12-19T18:45:10.346 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T18:45:10.364 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2023-12-19T18:45:10.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2023-12-19T18:45:10.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:10.460 DEBUG:teuthology.orchestra.run.smithi012:> true
2023-12-19T18:45:10.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com'
2023-12-19T18:45:10.640 DEBUG:teuthology.orchestra.run.smithi012:> uname -m
2023-12-19T18:45:10.695 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2023-12-19T18:45:10.696 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2023-12-19T18:45:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2023-12-19T18:45:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2023-12-19T18:45:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2023-12-19T18:45:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2023-12-19T18:45:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-19T18:45:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T18:45:10.752 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2023-12-19T18:45:10.771 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2023-12-19T18:45:10.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2023-12-19T18:45:10.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:10.854 DEBUG:teuthology.orchestra.run.smithi100:> true
2023-12-19T18:45:10.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2023-12-19T18:45:10.920 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2023-12-19T18:45:10.975 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2023-12-19T18:45:10.975 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2023-12-19T18:45:11.030 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2023-12-19T18:45:11.030 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2023-12-19T18:45:11.030 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2023-12-19T18:45:11.030 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2023-12-19T18:45:11.030 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2023-12-19T18:45:11.030 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2023-12-19T18:45:11.030 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-19T18:45:11.031 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2023-12-19T18:45:11.031 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2023-12-19T18:45:11.031 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-19T18:45:11.031 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2023-12-19T18:45:11.031 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:45:11.031 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-19T18:45:11.031 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T18:45:11.031 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2023-12-19T18:45:11.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:45:11.235 INFO:teuthology.dispatcher.supervisor:Running job 7497311
2023-12-19T18:45:11.235 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497311 --name yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497311/orig.config.yaml
2023-12-19T18:45:11.238 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497311
2023-12-19T18:45:11.239 INFO:teuthology.dispatcher.supervisor:Job PID: 1639833
2023-12-19T18:45:11.239 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-19T18:47:11.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:49:11.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:51:11.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:53:11.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:55:11.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:57:11.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:59:11.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:01:11.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:03:11.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:05:11.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:07:11.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:09:12.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:11:12.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:13:12.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:15:12.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:17:12.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:19:12.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:21:12.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:23:12.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:25:12.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:27:12.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:29:12.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:31:12.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:33:12.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:35:13.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:37:13.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:39:13.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:41:13.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:43:13.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:45:13.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:47:13.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:49:13.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:51:13.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:53:13.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:55:13.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:57:13.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T19:59:13.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:01:13.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:03:14.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:05:14.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:07:14.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:09:14.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:11:14.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:13:14.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:15:14.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:17:14.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:19:14.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:21:14.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:23:14.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:25:14.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:27:14.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:29:15.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:31:15.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:33:15.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:35:15.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:37:15.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:39:15.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:41:15.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:43:15.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:45:15.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:47:15.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:49:15.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:51:16.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:53:16.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:55:16.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:57:16.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T20:59:16.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:01:16.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:03:16.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:05:16.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:07:16.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:09:16.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:11:16.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:13:16.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:15:16.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:17:17.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:19:17.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:21:17.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:23:17.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:25:17.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:27:17.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:29:17.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:31:17.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:33:17.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:35:17.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:37:17.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:39:17.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:41:18.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:43:18.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:45:18.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:47:18.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:49:18.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:51:18.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:53:18.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:55:18.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:57:18.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T21:59:19.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:01:19.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:03:19.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:05:19.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:07:19.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:09:19.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:11:19.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:13:19.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:15:19.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:17:20.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:19:20.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:21:20.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:23:20.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:25:20.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:27:20.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:29:20.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T22:29:20.577 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-19T22:29:20.766 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-19T22:29:20.766 INFO:teuthology.nuke:Checking targets against current locks
2023-12-19T22:29:20.816 DEBUG:teuthology.nuke:shortname: smithi012
2023-12-19T22:29:20.817 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T22:29:20.829 DEBUG:teuthology.nuke:shortname: smithi100
2023-12-19T22:29:20.829 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T22:29:20.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:40:08.238619', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO++VFx6A7EvuYtnzF73N9Mj8JTVg7ALfbLwLnXF9oiiu3cP02RD7SDGxex6pQ1rByLWtThNkahzZZKXp4ZrM8E='}
2023-12-19T22:29:20.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:40:08.236689', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNL3iXuDQXSfm0aXXYzW/fTUpBUXdR3/3hdWATquCOBCNFks5MqsoUKbvJ3JkLXGKxURL5huovCZwF4aQGD/4Y='}
2023-12-19T22:29:20.875 INFO:teuthology.orchestra.console.smithi012:Power off
2023-12-19T22:29:20.875 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T22:29:20.904 INFO:teuthology.orchestra.console.smithi100:Power off
2023-12-19T22:29:20.904 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T22:29:20.911 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off
2023-12-19T22:29:20.911 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T22:29:20.925 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2023-12-19T22:29:20.926 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T22:29:20.932 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2023-12-19T22:29:20.944 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2023-12-19T22:29:21.033 INFO:teuthology.orchestra.console.smithi012:Power off completed
2023-12-19T22:29:21.045 INFO:teuthology.orchestra.console.smithi100:Power off completed
2023-12-19T22:29:21.184 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com
2023-12-19T22:29:21.192 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com