2024-01-24T21:32:18.258 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T21:32:18.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:32:18.390 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f38f428df40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f38f51f3c10>, signals=[15])
2024-01-24T21:32:18.391 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging
2024-01-24T21:32:18.391 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T21:32:18.391 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2024-01-24T21:32:18.416 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging
2024-01-24T21:32:18.417 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T21:32:18.417 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2024-01-24T21:32:18.546 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10)
2024-01-24T21:32:18.550 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_9.stream (ID 10)
2024-01-24T21:32:18.593 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 9.stream
2024-01-24T21:32:18.596 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream
2024-01-24T21:32:18.810 INFO:teuthology.orchestra.console.smithi143:Power off
2024-01-24T21:32:18.810 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T21:32:18.824 INFO:teuthology.orchestra.console.smithi059:Power off
2024-01-24T21:32:18.824 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T21:32:18.834 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2024-01-24T21:32:18.834 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:18.845 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2024-01-24T21:32:18.845 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:18.859 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-24T21:32:18.871 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-01-24T21:32:22.860 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:22.872 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:22.968 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-24T21:32:22.982 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-01-24T21:32:26.972 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:26.983 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:27.080 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-24T21:32:27.092 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-01-24T21:32:31.086 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:31.093 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:31.195 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-24T21:32:31.201 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-01-24T21:32:31.297 INFO:teuthology.orchestra.console.smithi143:Power off completed
2024-01-24T21:32:31.302 INFO:teuthology.orchestra.console.smithi059:Power off completed
2024-01-24T21:32:31.398 INFO:teuthology.orchestra.console.smithi143:Power on
2024-01-24T21:32:31.398 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T21:32:31.406 INFO:teuthology.orchestra.console.smithi059:Power on
2024-01-24T21:32:31.406 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T21:32:31.419 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On
2024-01-24T21:32:31.420 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:31.429 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On
2024-01-24T21:32:31.429 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:31.445 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-24T21:32:31.448 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-01-24T21:32:35.448 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:35.454 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T21:32:35.557 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-24T21:32:35.564 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-01-24T21:32:35.658 INFO:teuthology.orchestra.console.smithi143:Power on completed
2024-01-24T21:32:35.664 INFO:teuthology.orchestra.console.smithi059:Power on completed
2024-01-24T21:32:35.759 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2024-01-24T21:32:35.765 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2024-01-24T21:35:06.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:09.888 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-01-24T21:35:15.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:18.972 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-01-24T21:35:21.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:24.959 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:35:24.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:28.031 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-01-24T21:35:30.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:34.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:34.048 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:35:37.084 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-01-24T21:35:40.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:43.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:43.132 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:35:46.144 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-01-24T21:35:49.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:52.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:35:52.188 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:35:55.228 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-01-24T21:35:58.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:36:01.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:36:01.244 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:36:07.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:36:25.660 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:36:31.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:36:34.748 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:36:40.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:36:43.839 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-24T21:36:49.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:36:50.096 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T21:36:50.096 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T21:37:01.235 WARNING:teuthology.provision.fog.smithi059:timed out
2024-01-24T21:37:07.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:37:07.449 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T21:37:07.449 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T21:37:07.790 INFO:teuthology.provision.fog.smithi059:Node is ready
2024-01-24T21:37:07.791 DEBUG:teuthology.orchestra.run.smithi059:> hostname
2024-01-24T21:37:07.806 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2024-01-24T21:37:07.806 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts
2024-01-24T21:37:07.862 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2024-01-24T21:37:07.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2024-01-24T21:37:07.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts
2024-01-24T21:37:08.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts
2024-01-24T21:37:08.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname
2024-01-24T21:37:08.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2024-01-24T21:37:08.223 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2024-01-24T21:37:08.277 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T21:37:08.278 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T21:37:08.279 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2024-01-24T21:37:08.281 DEBUG:teuthology.parallel:result is None
2024-01-24T21:37:10.468 INFO:teuthology.provision.fog.smithi143:Node is ready
2024-01-24T21:37:10.468 DEBUG:teuthology.orchestra.run.smithi143:> hostname
2024-01-24T21:37:10.486 INFO:teuthology.orchestra.run.smithi143.stdout:smithi046
2024-01-24T21:37:10.487 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi046 /etc/hosts
2024-01-24T21:37:10.545 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-01-24T21:37:10.545 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2024-01-24T21:37:10.700 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi046/smithi143/g' /etc/hosts
2024-01-24T21:37:10.732 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.46/172.21.15.143/g' /etc/hosts
2024-01-24T21:37:10.803 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi046/smithi143/g' /etc/hostname
2024-01-24T21:37:10.905 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2024-01-24T21:37:10.932 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2024-01-24T21:37:10.987 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream"
2024-01-24T21:37:10.987 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T21:37:10.989 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2024-01-24T21:37:10.989 DEBUG:teuthology.parallel:result is None
2024-01-24T21:37:11.154 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2024-01-24T21:37:11.154 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T21:37:11.173 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2024-01-24T21:37:11.173 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T21:37:11.191 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2024-01-24T21:37:11.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2024-01-24T21:37:11.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:37:11.293 DEBUG:teuthology.orchestra.run.smithi059:> true
2024-01-24T21:37:11.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com'
2024-01-24T21:37:11.364 DEBUG:teuthology.orchestra.run.smithi059:> uname -m
2024-01-24T21:37:11.421 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2024-01-24T21:37:11.422 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9"
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9"
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9"
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T21:37:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2024-01-24T21:37:11.480 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon"
2024-01-24T21:37:11.480 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T21:37:11.480 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2024-01-24T21:37:11.480 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T21:37:11.480 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T21:37:11.480 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T21:37:11.481 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2024-01-24T21:37:11.507 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2024-01-24T21:37:11.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com'
2024-01-24T21:37:11.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T21:37:11.597 DEBUG:teuthology.orchestra.run.smithi143:> true
2024-01-24T21:37:11.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com'
2024-01-24T21:37:11.665 DEBUG:teuthology.orchestra.run.smithi143:> uname -m
2024-01-24T21:37:11.719 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2024-01-24T21:37:11.719 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T21:37:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/"
2024-01-24T21:37:11.775 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T21:37:11.775 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T21:37:11.775 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T21:37:11.775 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2024-01-24T21:37:11.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:37:11.886 INFO:teuthology.dispatcher.supervisor:Running job 7531121
2024-01-24T21:37:11.886 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-24_21:27:06-rados-wip-yuri3-testing-2024-01-22-1155-distro-default-smithi/7531121 --name yuriw-2024-01-24_21:27:06-rados-wip-yuri3-testing-2024-01-22-1155-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2024-01-24_21:27:06-rados-wip-yuri3-testing-2024-01-22-1155-distro-default-smithi/7531121/orig.config.yaml
2024-01-24T21:37:11.889 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-24_21:27:06-rados-wip-yuri3-testing-2024-01-22-1155-distro-default-smithi/7531121
2024-01-24T21:37:11.889 INFO:teuthology.dispatcher.supervisor:Job PID: 1430409
2024-01-24T21:37:11.889 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T21:39:11.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:41:12.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:43:12.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:45:12.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:47:12.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:49:12.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:51:13.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:53:13.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:55:13.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:57:13.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T21:59:13.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:01:13.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:03:14.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:05:14.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:07:14.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:09:14.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:11:14.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:13:14.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:15:15.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:17:15.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:19:15.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:21:15.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:23:15.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:25:15.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:27:16.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:29:16.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:31:16.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:33:16.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:35:16.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:37:16.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:39:17.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:41:17.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:43:17.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:45:17.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:47:17.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:49:17.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:51:18.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:53:18.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:55:18.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:57:18.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T22:59:18.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:01:18.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:03:19.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:05:19.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:07:19.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:09:19.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:11:19.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:13:19.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:15:19.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:17:20.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:19:20.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:21:20.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:23:20.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:25:20.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:27:20.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:29:21.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:31:21.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:33:21.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:35:21.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T23:35:21.669 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T23:35:21.829 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T23:35:21.830 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T23:35:21.877 DEBUG:teuthology.nuke:shortname: smithi059
2024-01-24T23:35:21.878 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T23:35:21.903 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-24_21:27:06-rados-wip-yuri3-testing-2024-01-22-1155-distro-default-smithi/7531121', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 21:32:17.219951', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxGi0oWIxRnlI4jDrVi6N+obDRiKTymInw4tGrkRvYwAoQqEYcH6AsToRbOvfbfincB2SINheWp3G8YWndYFmc='}
2024-01-24T23:35:21.907 DEBUG:teuthology.nuke:shortname: smithi143
2024-01-24T23:35:21.907 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T23:35:21.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-24_21:27:06-rados-wip-yuri3-testing-2024-01-22-1155-distro-default-smithi/7531121', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 21:32:17.218124', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFiXbRZcXhN+8+ZgXeXRE+NGBnPvFenhat5Z2ARiwRQUnJhTrVzLAz5sQV9GklqJANOidNVDMkYDlaP4N//ZU6U='}
2024-01-24T23:35:21.960 INFO:teuthology.orchestra.console.smithi059:Power off
2024-01-24T23:35:21.961 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T23:35:21.983 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2024-01-24T23:35:21.983 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T23:35:22.001 INFO:teuthology.orchestra.console.smithi143:Power off
2024-01-24T23:35:22.001 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T23:35:22.010 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-01-24T23:35:22.023 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2024-01-24T23:35:22.023 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T23:35:22.044 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-24T23:35:22.111 INFO:teuthology.orchestra.console.smithi059:Power off completed
2024-01-24T23:35:22.145 INFO:teuthology.orchestra.console.smithi143:Power off completed
2024-01-24T23:35:22.259 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com
2024-01-24T23:35:22.285 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com