2023-11-30T22:02:18.038 INFO:root:teuthology version: 0.0.1.dev212+g595fad1
2023-11-30T22:02:18.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:02:18.182 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1fcb4a6880>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1fcbfab550>, signals=[15])
2023-11-30T22:02:18.182 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2023-11-30T22:02:18.182 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2023-11-30T22:02:18.183 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2023-11-30T22:02:18.209 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-11-30T22:02:18.210 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-11-30T22:02:18.210 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-11-30T22:02:18.328 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_8.stream (ID 3)
2023-11-30T22:02:18.345 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_8.stream (ID 3)
2023-11-30T22:02:18.366 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 8.stream
2023-11-30T22:02:18.392 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream
2023-11-30T22:02:18.662 INFO:teuthology.orchestra.console.smithi028:Power off
2023-11-30T22:02:18.662 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-30T22:02:18.675 INFO:teuthology.orchestra.console.smithi043:Power off
2023-11-30T22:02:18.675 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-30T22:02:18.682 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2023-11-30T22:02:18.683 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T22:02:18.694 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-11-30T22:02:18.694 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T22:02:18.704 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2023-11-30T22:02:18.713 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-11-30T22:02:18.805 INFO:teuthology.orchestra.console.smithi028:Power off completed
2023-11-30T22:02:18.814 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-11-30T22:02:18.906 INFO:teuthology.orchestra.console.smithi028:Power on
2023-11-30T22:02:18.906 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-30T22:02:18.916 INFO:teuthology.orchestra.console.smithi043:Power on
2023-11-30T22:02:18.916 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-30T22:02:18.929 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2023-11-30T22:02:18.929 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T22:02:18.938 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2023-11-30T22:02:18.938 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T22:02:18.954 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2023-11-30T22:02:18.961 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-11-30T22:02:22.958 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T22:02:22.965 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T22:02:23.067 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2023-11-30T22:02:23.074 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2023-11-30T22:02:23.168 INFO:teuthology.orchestra.console.smithi028:Power on completed
2023-11-30T22:02:23.174 INFO:teuthology.orchestra.console.smithi043:Power on completed
2023-11-30T22:02:23.269 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2023-11-30T22:02:23.275 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-11-30T22:04:54.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:04:54.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:04:57.346 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-30T22:04:57.347 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2023-11-30T22:05:03.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:03.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:06.402 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-30T22:05:06.403 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2023-11-30T22:05:12.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:12.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:15.490 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2023-11-30T22:05:15.491 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-30T22:05:21.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:21.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:24.582 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2023-11-30T22:05:24.582 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-30T22:05:30.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:30.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:33.666 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-30T22:05:39.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:05:42.754 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-30T22:05:48.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:06:30.631 WARNING:teuthology.provision.fog.smithi028:timed out
2023-11-30T22:06:36.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:06:36.923 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-30T22:06:36.923 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-30T22:06:37.188 INFO:teuthology.provision.fog.smithi028:Node is ready
2023-11-30T22:06:37.189 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2023-11-30T22:06:37.211 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2023-11-30T22:06:37.212 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2023-11-30T22:06:37.274 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2023-11-30T22:06:37.274 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2023-11-30T22:06:37.387 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2023-11-30T22:06:37.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2023-11-30T22:06:37.490 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2023-11-30T22:06:37.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2023-11-30T22:06:37.630 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2023-11-30T22:06:37.690 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2023-11-30T22:06:37.690 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8"
2023-11-30T22:06:37.690 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2023-11-30T22:06:37.690 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2023-11-30T22:06:37.690 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8"
2023-11-30T22:06:37.690 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2023-11-30T22:06:37.690 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-30T22:06:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2023-11-30T22:06:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-30T22:06:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2023-11-30T22:06:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-30T22:06:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-30T22:06:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-30T22:06:37.692 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2023-11-30T22:06:37.693 DEBUG:teuthology.parallel:result is None
2023-11-30T22:06:48.772 WARNING:teuthology.provision.fog.smithi043:timed out
2023-11-30T22:06:54.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:06:54.986 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-30T22:06:54.987 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-30T22:06:55.213 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-11-30T22:06:55.214 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2023-11-30T22:06:55.275 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2023-11-30T22:06:55.275 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2023-11-30T22:06:55.337 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2023-11-30T22:06:55.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-11-30T22:06:55.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2023-11-30T22:06:55.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2023-11-30T22:06:55.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2023-11-30T22:06:55.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-11-30T22:06:55.703 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-11-30T22:06:55.764 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2023-11-30T22:06:55.764 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8"
2023-11-30T22:06:55.765 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2023-11-30T22:06:55.765 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2023-11-30T22:06:55.765 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8"
2023-11-30T22:06:55.766 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-11-30T22:06:55.766 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-30T22:06:55.767 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-11-30T22:06:55.767 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-30T22:06:55.768 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2023-11-30T22:06:55.768 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-30T22:06:55.768 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-30T22:06:55.768 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-30T22:06:55.769 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-11-30T22:06:55.770 DEBUG:teuthology.parallel:result is None
2023-11-30T22:06:55.943 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2023-11-30T22:06:55.944 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-30T22:06:55.966 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2023-11-30T22:06:55.966 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-30T22:06:55.993 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2023-11-30T22:06:55.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2023-11-30T22:06:55.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:06:56.063 DEBUG:teuthology.orchestra.run.smithi028:> true
2023-11-30T22:06:56.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2023-11-30T22:06:56.202 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2023-11-30T22:06:56.262 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2023-11-30T22:06:56.262 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2023-11-30T22:06:56.321 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-30T22:06:56.322 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-30T22:06:56.323 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-30T22:06:56.323 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2023-11-30T22:06:56.348 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2023-11-30T22:06:56.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-11-30T22:06:56.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-30T22:06:56.416 DEBUG:teuthology.orchestra.run.smithi043:> true
2023-11-30T22:06:56.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-11-30T22:06:56.489 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2023-11-30T22:06:56.551 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2023-11-30T22:06:56.551 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-11-30T22:06:56.612 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2023-11-30T22:06:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8"
2023-11-30T22:06:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2023-11-30T22:06:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2023-11-30T22:06:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8"
2023-11-30T22:06:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-11-30T22:06:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-30T22:06:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-11-30T22:06:56.614 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-30T22:06:56.614 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2023-11-30T22:06:56.614 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-30T22:06:56.614 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-30T22:06:56.614 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-30T22:06:56.614 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-11-30T22:06:56.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:06:56.761 INFO:teuthology.dispatcher.supervisor:Running job 7472606
2023-11-30T22:06:56.761 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472606 --name yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472606/orig.config.yaml
2023-11-30T22:06:56.768 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472606
2023-11-30T22:06:56.769 INFO:teuthology.dispatcher.supervisor:Job PID: 2508281
2023-11-30T22:06:56.769 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-30T22:08:56.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:10:57.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:12:57.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:14:57.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:16:57.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:18:57.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:20:57.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:22:58.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:24:58.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:26:58.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:28:58.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:30:58.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:32:58.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:34:59.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:36:59.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:38:59.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:40:59.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:42:59.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:45:00.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:47:00.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:49:00.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:51:00.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:53:00.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:55:00.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:57:01.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T22:59:01.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T23:01:01.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T23:03:01.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T23:05:01.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T23:07:01.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T23:09:02.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-30T23:09:02.169 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-30T23:09:02.454 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-30T23:09:02.454 INFO:teuthology.nuke:Checking targets against current locks
2023-11-30T23:09:02.508 DEBUG:teuthology.nuke:shortname: smithi028
2023-11-30T23:09:02.508 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-30T23:09:02.532 DEBUG:teuthology.nuke:shortname: smithi043
2023-11-30T23:09:02.533 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-30T23:09:02.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:02:17.209582', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCB8e6LF9Sc0bVq2/vAa2xt7NG7Mo5YDM8eIZ+jmZwdRxWa9bfoU9NIHroUnDP3yz3W0xhOU95LOrYwyjDkpMpA='}
2023-11-30T23:09:02.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:02:17.208125', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6Y8yzVAAQ13qKAlRC6uFekLItWnbabierOiJdD28qx4vfBKyDcUWiCM+2Vv0B8Smy6ntPQ77UEW8mldQ1Y9ls='}
2023-11-30T23:09:02.606 INFO:teuthology.orchestra.console.smithi028:Power off
2023-11-30T23:09:02.607 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-30T23:09:02.674 INFO:teuthology.orchestra.console.smithi043:Power off
2023-11-30T23:09:02.674 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-30T23:09:02.687 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2023-11-30T23:09:02.687 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T23:09:02.705 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-11-30T23:09:02.705 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-30T23:09:02.722 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2023-11-30T23:09:02.736 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-11-30T23:09:02.823 INFO:teuthology.orchestra.console.smithi028:Power off completed
2023-11-30T23:09:02.838 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-11-30T23:09:02.976 INFO:teuthology.lock.ops:unlocked: smithi028.front.sepia.ceph.com
2023-11-30T23:09:02.984 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com