2024-01-20T19:40:07.380 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-20T19:40:07.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:40:07.514 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb797a62f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb798ac8c10>, signals=[15])
2024-01-20T19:40:07.514 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging
2024-01-20T19:40:07.515 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server
2024-01-20T19:40:07.515 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2024-01-20T19:40:07.540 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2024-01-20T19:40:07.540 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2024-01-20T19:40:07.541 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2024-01-20T19:40:07.658 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_9.stream (ID 10)
2024-01-20T19:40:07.669 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10)
2024-01-20T19:40:07.711 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 9.stream
2024-01-20T19:40:07.715 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream
2024-01-20T19:40:07.929 INFO:teuthology.orchestra.console.smithi187:Power off
2024-01-20T19:40:07.929 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T19:40:07.943 INFO:teuthology.orchestra.console.smithi055:Power off
2024-01-20T19:40:07.943 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T19:40:07.954 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2024-01-20T19:40:07.954 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:07.981 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off
2024-01-20T19:40:07.981 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:07.992 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-01-20T19:40:08.012 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2024-01-20T19:40:11.995 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:12.013 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:12.103 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-01-20T19:40:12.121 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2024-01-20T19:40:16.109 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:16.122 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:16.218 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-01-20T19:40:16.230 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-01-20T19:40:16.330 INFO:teuthology.orchestra.console.smithi055:Power off completed
2024-01-20T19:40:16.431 INFO:teuthology.orchestra.console.smithi055:Power on
2024-01-20T19:40:16.431 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-20T19:40:16.454 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On
2024-01-20T19:40:16.455 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:16.475 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-01-20T19:40:20.220 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:20.330 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-20T19:40:20.430 INFO:teuthology.orchestra.console.smithi187:Power off completed
2024-01-20T19:40:20.476 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:20.532 INFO:teuthology.orchestra.console.smithi187:Power on
2024-01-20T19:40:20.532 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-20T19:40:20.553 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On
2024-01-20T19:40:20.553 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:20.575 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-20T19:40:20.584 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-01-20T19:40:24.580 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:24.586 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:24.688 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-20T19:40:24.695 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2024-01-20T19:40:24.796 INFO:teuthology.orchestra.console.smithi055:Power on completed
2024-01-20T19:40:24.896 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish
2024-01-20T19:40:28.693 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T19:40:28.802 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-01-20T19:40:28.903 INFO:teuthology.orchestra.console.smithi187:Power on completed
2024-01-20T19:40:29.003 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2024-01-20T19:42:40.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:42:40.732 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-20T19:42:55.036 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2024-01-20T19:43:01.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:43:04.096 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2024-01-20T19:43:10.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:43:13.152 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2024-01-20T19:43:14.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:43:19.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:43:22.204 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2024-01-20T19:43:28.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:43:33.184 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-20T19:43:39.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:43:42.236 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-20T19:43:48.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:43:51.292 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-20T19:43:57.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:44:00.348 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-20T19:44:06.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:44:24.895 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-20T19:44:28.207 WARNING:teuthology.provision.fog.smithi055:timed out
2024-01-20T19:44:30.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:44:33.948 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-20T19:44:34.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:44:34.473 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-20T19:44:34.474 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-20T19:44:34.815 INFO:teuthology.provision.fog.smithi055:Node is ready
2024-01-20T19:44:34.815 DEBUG:teuthology.orchestra.run.smithi055:> hostname
2024-01-20T19:44:34.831 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com
2024-01-20T19:44:34.831 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts
2024-01-20T19:44:34.887 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055
2024-01-20T19:44:34.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2024-01-20T19:44:35.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts
2024-01-20T19:44:35.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts
2024-01-20T19:44:35.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname
2024-01-20T19:44:35.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2024-01-20T19:44:35.253 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2024-01-20T19:44:35.308 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon"
2024-01-20T19:44:35.309 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T19:44:35.309 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/"
2024-01-20T19:44:35.309 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T19:44:35.309 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T19:44:35.309 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T19:44:35.309 INFO:teuthology.provision.fog.smithi055:Deploy complete!
2024-01-20T19:44:35.311 DEBUG:teuthology.parallel:result is None
2024-01-20T19:44:39.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:44:43.008 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-20T19:44:49.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:44:49.293 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-20T19:44:49.293 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-20T19:45:09.653 INFO:teuthology.provision.fog.smithi187:Node is ready
2024-01-20T19:45:09.654 DEBUG:teuthology.orchestra.run.smithi187:> hostname
2024-01-20T19:45:09.673 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com
2024-01-20T19:45:09.673 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts
2024-01-20T19:45:09.731 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187
2024-01-20T19:45:09.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2024-01-20T19:45:09.855 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts
2024-01-20T19:45:09.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts
2024-01-20T19:45:09.955 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname
2024-01-20T19:45:10.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2024-01-20T19:45:10.090 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2024-01-20T19:45:10.144 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2024-01-20T19:45:10.144 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T19:45:10.145 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T19:45:10.146 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2024-01-20T19:45:10.146 DEBUG:teuthology.parallel:result is None
2024-01-20T19:45:10.312 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com
2024-01-20T19:45:10.312 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-20T19:45:10.336 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2024-01-20T19:45:10.336 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-20T19:45:10.353 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server
2024-01-20T19:45:10.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com'
2024-01-20T19:45:10.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:45:10.457 DEBUG:teuthology.orchestra.run.smithi055:> true
2024-01-20T19:45:10.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com'
2024-01-20T19:45:10.635 DEBUG:teuthology.orchestra.run.smithi055:> uname -m
2024-01-20T19:45:10.689 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64
2024-01-20T19:45:10.690 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release
2024-01-20T19:45:10.744 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream"
2024-01-20T19:45:10.744 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9"
2024-01-20T19:45:10.744 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T19:45:10.745 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T19:45:10.746 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2024-01-20T19:45:10.770 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2024-01-20T19:45:10.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2024-01-20T19:45:10.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T19:45:10.856 DEBUG:teuthology.orchestra.run.smithi187:> true
2024-01-20T19:45:10.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com'
2024-01-20T19:45:10.923 DEBUG:teuthology.orchestra.run.smithi187:> uname -m
2024-01-20T19:45:10.977 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2024-01-20T19:45:10.977 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2024-01-20T19:45:11.032 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2024-01-20T19:45:11.032 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9"
2024-01-20T19:45:11.032 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2024-01-20T19:45:11.032 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2024-01-20T19:45:11.032 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T19:45:11.033 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T19:45:11.034 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2024-01-20T19:45:11.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:45:11.143 INFO:teuthology.dispatcher.supervisor:Running job 7523101
2024-01-20T19:45:11.143 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_15:25:09-rados-main-distro-default-smithi/7523101 --name yuriw-2024-01-19_15:25:09-rados-main-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} -- /home/teuthworker/archive/yuriw-2024-01-19_15:25:09-rados-main-distro-default-smithi/7523101/orig.config.yaml
2024-01-20T19:45:11.146 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-19_15:25:09-rados-main-distro-default-smithi/7523101
2024-01-20T19:45:11.147 INFO:teuthology.dispatcher.supervisor:Job PID: 4020460
2024-01-20T19:45:11.147 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-20T19:47:11.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:49:11.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:51:11.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:53:11.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:55:11.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:57:11.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T19:59:11.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:01:11.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:03:11.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:05:11.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:07:11.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:09:11.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:11:12.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:13:12.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:15:12.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:17:12.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:19:12.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:21:12.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:23:12.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:25:12.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:27:12.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:29:12.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:31:12.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:33:12.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:35:12.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:37:12.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:39:13.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:41:13.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:43:13.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:45:13.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:47:13.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:49:13.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:51:13.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:53:13.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:55:13.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:57:13.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T20:59:13.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:01:13.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:03:13.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:05:14.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:07:14.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:09:14.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:11:14.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:13:14.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:15:14.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:17:14.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:19:14.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:21:14.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:23:14.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:25:14.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:27:14.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:29:14.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:31:14.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:33:14.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:35:15.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:37:15.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:39:15.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:41:15.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:43:15.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:45:15.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:47:15.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:49:15.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:51:15.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:53:15.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:55:15.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:57:16.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T21:59:16.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:01:16.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:03:16.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:05:16.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:07:16.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:09:16.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:11:16.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:13:16.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:15:16.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:17:16.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:19:16.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:21:16.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:23:16.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:25:17.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:27:17.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:29:17.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:31:17.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:33:17.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:35:17.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:37:17.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:39:17.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:41:17.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:43:17.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:45:17.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:47:17.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:49:17.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:51:18.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:53:18.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:55:18.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:57:18.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T22:59:18.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T23:01:18.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T23:03:18.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T23:05:18.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T23:05:18.559 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-20T23:05:18.748 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-20T23:05:18.748 INFO:teuthology.nuke:Checking targets against current locks
2024-01-20T23:05:18.793 DEBUG:teuthology.nuke:shortname: smithi055
2024-01-20T23:05:18.793 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-20T23:05:18.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:25:09-rados-main-distro-default-smithi/7523101', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 19:40:06.367834', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQKvjmkfpowjxIdduNHIxLE2+ectQA/EigrBEnqrqr8SwWtvd94TmKmK2gyBxtQzmTtrauPxF6jHQpbvfo1o9E='}
2024-01-20T23:05:18.816 DEBUG:teuthology.nuke:shortname: smithi187
2024-01-20T23:05:18.816 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-20T23:05:18.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:25:09-rados-main-distro-default-smithi/7523101', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 19:40:06.369476', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0QVZGESWkzhKanzXA8ZovWwClXmeKdQGQtPZMOZNvyvcUezx9n3TjM4EnbmGFeYOCT0FEKbwtIcms/PbEIFAc='}
2024-01-20T23:05:18.850 INFO:teuthology.orchestra.console.smithi055:Power off
2024-01-20T23:05:18.851 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T23:05:18.873 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off
2024-01-20T23:05:18.874 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T23:05:18.889 INFO:teuthology.orchestra.console.smithi187:Power off
2024-01-20T23:05:18.889 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T23:05:18.897 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-01-20T23:05:18.911 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2024-01-20T23:05:18.911 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T23:05:18.932 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-20T23:05:18.998 INFO:teuthology.orchestra.console.smithi055:Power off completed
2024-01-20T23:05:19.033 INFO:teuthology.orchestra.console.smithi187:Power off completed
2024-01-20T23:05:19.143 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com
2024-01-20T23:05:19.175 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com