2023-11-22T16:09:52.852 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-22T16:09:52.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:09:52.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4b8f09c9a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4b8ed99c10>, signals=[15])
2023-11-22T16:09:52.991 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-11-22T16:09:52.991 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-11-22T16:09:52.992 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-11-22T16:09:53.011 INFO:teuthology.lock.ops:Start node 'smithi091.front.sepia.ceph.com' reimaging
2023-11-22T16:09:53.012 INFO:teuthology.lock.ops:Updating [smithi091.front.sepia.ceph.com]: reset os type and version on server
2023-11-22T16:09:53.012 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server
2023-11-22T16:09:53.121 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10)
2023-11-22T16:09:53.131 DEBUG:teuthology.provision.fog.smithi091:Requesting image smithi_centos_9.stream (ID 10)
2023-11-22T16:09:53.165 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream
2023-11-22T16:09:53.176 INFO:teuthology.provision.fog.smithi091:Scheduling deploy of centos 9.stream
2023-11-22T16:09:53.503 INFO:teuthology.orchestra.console.smithi091:Power off
2023-11-22T16:09:53.503 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T16:09:53.515 INFO:teuthology.orchestra.console.smithi043:Power off
2023-11-22T16:09:53.515 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T16:09:53.524 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off
2023-11-22T16:09:53.524 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:09:53.536 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-11-22T16:09:53.536 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:09:53.542 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-22T16:09:53.555 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-11-22T16:09:53.644 INFO:teuthology.orchestra.console.smithi091:Power off completed
2023-11-22T16:09:53.656 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-11-22T16:09:53.745 INFO:teuthology.orchestra.console.smithi091:Power on
2023-11-22T16:09:53.745 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-22T16:09:53.758 INFO:teuthology.orchestra.console.smithi043:Power on
2023-11-22T16:09:53.758 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-22T16:09:53.765 DEBUG:teuthology.orchestra.console.smithi091:power on output: Chassis Power Control: Up/On
2023-11-22T16:09:53.765 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:09:53.777 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2023-11-22T16:09:53.778 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:09:53.784 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-22T16:09:53.798 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-11-22T16:09:57.790 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:09:57.799 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:09:57.898 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-22T16:09:57.906 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-11-22T16:10:01.904 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:10:01.912 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:10:02.021 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on
2023-11-22T16:10:02.022 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2023-11-22T16:10:02.122 INFO:teuthology.orchestra.console.smithi091:Power on completed
2023-11-22T16:10:02.122 INFO:teuthology.orchestra.console.smithi043:Power on completed
2023-11-22T16:10:02.223 INFO:teuthology.provision.fog.smithi091:Waiting for deploy to finish
2023-11-22T16:10:02.225 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-11-22T16:12:33.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:12:33.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:12:36.738 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-22T16:12:36.770 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-22T16:12:42.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:12:42.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:12:45.830 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-22T16:12:45.831 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-22T16:12:51.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:12:51.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:12:54.914 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-22T16:12:54.915 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-22T16:13:00.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:13:00.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:13:04.002 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-22T16:13:04.002 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-22T16:13:10.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:13:10.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:13:13.090 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-22T16:13:13.090 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-11-22T16:13:19.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:13:19.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:13:22.178 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-22T16:13:28.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:13:31.266 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-22T16:13:37.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:14:19.145 WARNING:teuthology.provision.fog.smithi043:timed out
2023-11-22T16:14:25.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:14:25.396 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-22T16:14:25.396 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-22T16:14:25.750 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-11-22T16:14:25.750 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2023-11-22T16:14:25.764 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2023-11-22T16:14:25.764 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2023-11-22T16:14:25.821 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2023-11-22T16:14:25.821 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-11-22T16:14:25.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2023-11-22T16:14:25.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2023-11-22T16:14:26.035 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2023-11-22T16:14:26.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-11-22T16:14:26.175 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-11-22T16:14:26.230 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2023-11-22T16:14:26.230 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9"
2023-11-22T16:14:26.230 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T16:14:26.231 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T16:14:26.232 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-11-22T16:14:26.233 DEBUG:teuthology.parallel:result is None
2023-11-22T16:14:37.287 WARNING:teuthology.provision.fog.smithi091:timed out
2023-11-22T16:14:43.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:14:43.563 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-22T16:14:43.564 DEBUG:teuthology.orchestra.run.smithi091:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-22T16:14:43.891 INFO:teuthology.provision.fog.smithi091:Node is ready
2023-11-22T16:14:43.891 DEBUG:teuthology.orchestra.run.smithi091:> hostname
2023-11-22T16:14:43.906 INFO:teuthology.orchestra.run.smithi091.stdout:smithi091.front.sepia.ceph.com
2023-11-22T16:14:43.907 DEBUG:teuthology.orchestra.run.smithi091:> grep smithi091.front.sepia.ceph.com /etc/hosts
2023-11-22T16:14:43.966 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.15.91 smithi091.front.sepia.ceph.com smithi091
2023-11-22T16:14:43.967 DEBUG:teuthology.orchestra.run.smithi091:> sudo hostname smithi091
2023-11-22T16:14:44.086 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/smithi091.front.sepia.ceph.com/smithi091/g' /etc/hosts
2023-11-22T16:14:44.115 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/172.21.15.91/172.21.15.91/g' /etc/hosts
2023-11-22T16:14:44.185 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/smithi091.front.sepia.ceph.com/smithi091/g' /etc/hostname
2023-11-22T16:14:44.255 DEBUG:teuthology.orchestra.run.smithi091:> sudo hostname smithi091
2023-11-22T16:14:44.326 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release
2023-11-22T16:14:44.384 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="CentOS Stream"
2023-11-22T16:14:44.384 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="9"
2023-11-22T16:14:44.384 INFO:teuthology.orchestra.run.smithi091.stdout:ID="centos"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE="rhel fedora"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="9"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:PLATFORM_ID="platform:el9"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:ANSI_COLOR="0;31"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:LOGO="fedora-logo-icon"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://centos.org/"
2023-11-22T16:14:44.385 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T16:14:44.386 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T16:14:44.386 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T16:14:44.386 INFO:teuthology.provision.fog.smithi091:Deploy complete!
2023-11-22T16:14:44.387 DEBUG:teuthology.parallel:result is None
2023-11-22T16:14:44.596 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2023-11-22T16:14:44.596 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-22T16:14:44.623 INFO:teuthology.lock.ops:Checking smithi091.front.sepia.ceph.com
2023-11-22T16:14:44.623 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-22T16:14:44.648 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2023-11-22T16:14:44.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-11-22T16:14:44.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:14:44.748 DEBUG:teuthology.orchestra.run.smithi043:> true
2023-11-22T16:14:44.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-11-22T16:14:44.933 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2023-11-22T16:14:44.988 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2023-11-22T16:14:44.988 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9"
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9"
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9"
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T16:14:45.043 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-11-22T16:14:45.044 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon"
2023-11-22T16:14:45.044 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T16:14:45.044 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2023-11-22T16:14:45.044 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T16:14:45.044 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T16:14:45.044 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T16:14:45.045 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-11-22T16:14:45.065 INFO:teuthology.lock.ops:Updating [smithi091.front.sepia.ceph.com]: set os type and version on server
2023-11-22T16:14:45.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com'
2023-11-22T16:14:45.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T16:14:45.152 DEBUG:teuthology.orchestra.run.smithi091:> true
2023-11-22T16:14:45.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com'
2023-11-22T16:14:45.221 DEBUG:teuthology.orchestra.run.smithi091:> uname -m
2023-11-22T16:14:45.279 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64
2023-11-22T16:14:45.279 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release
2023-11-22T16:14:45.338 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="CentOS Stream"
2023-11-22T16:14:45.338 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="9"
2023-11-22T16:14:45.338 INFO:teuthology.orchestra.run.smithi091.stdout:ID="centos"
2023-11-22T16:14:45.338 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE="rhel fedora"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="9"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:PLATFORM_ID="platform:el9"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:ANSI_COLOR="0;31"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:LOGO="fedora-logo-icon"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://centos.org/"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T16:14:45.339 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T16:14:45.340 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server
2023-11-22T16:14:45.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:14:45.444 INFO:teuthology.dispatcher.supervisor:Running job 7464407
2023-11-22T16:14:45.444 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-11-22_16:05:11-rados:thrash-wip-rf-repl-hp-distro-default-smithi/7464407 --name rfriedma-2023-11-22_16:05:11-rados:thrash-wip-rf-repl-hp-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} -- /home/teuthworker/archive/rfriedma-2023-11-22_16:05:11-rados:thrash-wip-rf-repl-hp-distro-default-smithi/7464407/orig.config.yaml
2023-11-22T16:14:45.447 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-11-22_16:05:11-rados:thrash-wip-rf-repl-hp-distro-default-smithi/7464407
2023-11-22T16:14:45.448 INFO:teuthology.dispatcher.supervisor:Job PID: 3103
2023-11-22T16:14:45.448 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-22T16:16:45.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:18:45.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:20:45.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:22:50.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:24:56.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:26:56.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:28:56.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:30:56.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:32:56.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:34:56.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:36:56.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:38:57.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:40:57.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:42:57.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:44:57.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T16:44:57.822 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-22T16:44:57.922 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-22T16:44:57.922 INFO:teuthology.nuke:Checking targets against current locks
2023-11-22T16:44:57.969 DEBUG:teuthology.nuke:shortname: smithi043
2023-11-22T16:44:57.969 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-22T16:44:57.989 DEBUG:teuthology.nuke:shortname: smithi091
2023-11-22T16:44:57.989 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-22T16:44:57.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-11-22_16:05:11-rados:thrash-wip-rf-repl-hp-distro-default-smithi/7464407', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-22 16:09:52.053167', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNTu+ul2f5TVvnzqQioGaEFX1IQPjL2+oCqyri62VVux/YOlP/zKH4rwyhMHNbBwgefGBTcId4rPFFGyqc3yIE='}
2023-11-22T16:44:58.009 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-11-22_16:05:11-rados:thrash-wip-rf-repl-hp-distro-default-smithi/7464407', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-22 16:09:52.054346', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJFXrqE1cZk3LYAJwNsiTIP4giQU0Gt/2wifB49VGVrZeFebcHDmxPE5XMUVtnzlTlNoE473P+DQXzTNVCQB6uc='}
2023-11-22T16:44:58.041 INFO:teuthology.orchestra.console.smithi043:Power off
2023-11-22T16:44:58.041 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T16:44:58.054 INFO:teuthology.orchestra.console.smithi091:Power off
2023-11-22T16:44:58.055 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T16:44:58.063 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-11-22T16:44:58.063 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:44:58.074 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off
2023-11-22T16:44:58.074 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T16:44:58.082 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-11-22T16:44:58.093 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-22T16:44:58.183 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-11-22T16:44:58.194 INFO:teuthology.orchestra.console.smithi091:Power off completed
2023-11-22T16:44:58.330 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2023-11-22T16:44:58.339 INFO:teuthology.lock.ops:unlocked: smithi091.front.sepia.ceph.com