2023-11-22T08:15:28.259 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-22T08:15:28.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:15:28.431 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fba78674880>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fba79177670>, signals=[15])
2023-11-22T08:15:28.431 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging
2023-11-22T08:15:28.432 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server
2023-11-22T08:15:28.432 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2023-11-22T08:15:28.453 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2023-11-22T08:15:28.453 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2023-11-22T08:15:28.453 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-11-22T08:15:28.558 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10)
2023-11-22T08:15:28.587 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10)
2023-11-22T08:15:28.598 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream
2023-11-22T08:15:28.628 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream
2023-11-22T08:15:29.044 INFO:teuthology.orchestra.console.smithi017:Power off
2023-11-22T08:15:29.045 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T08:15:29.057 INFO:teuthology.orchestra.console.smithi167:Power off
2023-11-22T08:15:29.058 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T08:15:29.065 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2023-11-22T08:15:29.066 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:29.079 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2023-11-22T08:15:29.079 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:29.086 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2023-11-22T08:15:29.100 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-22T08:15:33.090 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:33.101 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:33.199 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2023-11-22T08:15:33.210 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-22T08:15:37.202 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:37.211 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:37.311 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2023-11-22T08:15:37.319 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-22T08:15:37.412 INFO:teuthology.orchestra.console.smithi017:Power off completed
2023-11-22T08:15:37.513 INFO:teuthology.orchestra.console.smithi017:Power on
2023-11-22T08:15:37.513 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-22T08:15:37.533 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On
2023-11-22T08:15:37.534 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:37.554 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2023-11-22T08:15:41.322 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:41.431 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-11-22T08:15:41.532 INFO:teuthology.orchestra.console.smithi167:Power off completed
2023-11-22T08:15:41.555 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:41.633 INFO:teuthology.orchestra.console.smithi167:Power on
2023-11-22T08:15:41.633 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-22T08:15:41.653 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On
2023-11-22T08:15:41.653 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:41.663 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2023-11-22T08:15:41.672 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-11-22T08:15:45.668 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:45.674 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T08:15:45.776 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2023-11-22T08:15:45.781 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-22T08:15:45.878 INFO:teuthology.orchestra.console.smithi017:Power on completed
2023-11-22T08:15:45.882 INFO:teuthology.orchestra.console.smithi167:Power on completed
2023-11-22T08:15:45.979 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2023-11-22T08:15:45.983 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2023-11-22T08:20:05.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:20:08.994 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-11-22T08:20:14.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:20:18.050 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-11-22T08:20:24.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:20:27.106 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-11-22T08:20:33.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:20:36.162 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-11-22T08:20:42.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:20:45.218 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-11-22T08:20:51.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:06.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:09.474 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-22T08:21:15.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:18.563 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-22T08:21:24.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:27.654 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-22T08:21:33.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:36.738 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-22T08:21:42.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:45.794 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-22T08:21:51.223 WARNING:teuthology.provision.fog.smithi017:timed out
2023-11-22T08:21:51.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:54.850 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-22T08:21:57.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:21:57.532 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-22T08:21:57.533 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-22T08:21:57.888 INFO:teuthology.provision.fog.smithi017:Node is ready
2023-11-22T08:21:57.888 DEBUG:teuthology.orchestra.run.smithi017:> hostname
2023-11-22T08:21:57.903 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2023-11-22T08:21:57.904 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts
2023-11-22T08:21:57.959 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2023-11-22T08:21:57.959 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2023-11-22T08:21:58.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts
2023-11-22T08:21:58.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts
2023-11-22T08:21:58.170 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname
2023-11-22T08:21:58.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2023-11-22T08:21:58.311 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T08:21:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2023-11-22T08:21:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2023-11-22T08:21:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T08:21:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2023-11-22T08:21:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T08:21:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T08:21:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T08:21:58.368 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2023-11-22T08:21:58.369 DEBUG:teuthology.parallel:result is None
2023-11-22T08:22:00.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:22:03.906 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-22T08:22:09.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:23:09.952 WARNING:teuthology.provision.fog.smithi167:timed out
2023-11-22T08:23:15.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:23:16.463 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-22T08:23:16.463 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-22T08:23:16.798 INFO:teuthology.provision.fog.smithi167:Node is ready
2023-11-22T08:23:16.798 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2023-11-22T08:23:16.813 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2023-11-22T08:23:16.813 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts
2023-11-22T08:23:16.867 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2023-11-22T08:23:16.867 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-11-22T08:23:16.972 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts
2023-11-22T08:23:16.999 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2023-11-22T08:23:17.066 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname
2023-11-22T08:23:17.131 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-11-22T08:23:17.198 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon"
2023-11-22T08:23:17.253 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T08:23:17.254 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2023-11-22T08:23:17.254 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T08:23:17.254 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T08:23:17.254 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T08:23:17.254 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2023-11-22T08:23:17.254 DEBUG:teuthology.parallel:result is None
2023-11-22T08:23:17.447 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2023-11-22T08:23:17.448 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-22T08:23:17.495 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2023-11-22T08:23:17.495 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-22T08:23:17.512 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2023-11-22T08:23:17.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2023-11-22T08:23:17.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:23:17.607 DEBUG:teuthology.orchestra.run.smithi017:> true
2023-11-22T08:23:17.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com'
2023-11-22T08:23:17.784 DEBUG:teuthology.orchestra.run.smithi017:> uname -m
2023-11-22T08:23:17.839 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2023-11-22T08:23:17.839 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2023-11-22T08:23:17.894 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2023-11-22T08:23:17.894 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2023-11-22T08:23:17.894 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2023-11-22T08:23:17.894 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2023-11-22T08:23:17.894 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2023-11-22T08:23:17.894 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T08:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T08:23:17.896 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2023-11-22T08:23:17.920 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2023-11-22T08:23:17.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-11-22T08:23:17.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-22T08:23:18.002 DEBUG:teuthology.orchestra.run.smithi167:> true
2023-11-22T08:23:18.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-11-22T08:23:18.069 DEBUG:teuthology.orchestra.run.smithi167:> uname -m
2023-11-22T08:23:18.123 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2023-11-22T08:23:18.123 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-11-22T08:23:18.177 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2023-11-22T08:23:18.177 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9"
2023-11-22T08:23:18.178 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2023-11-22T08:23:18.178 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2023-11-22T08:23:18.178 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9"
2023-11-22T08:23:18.178 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-22T08:23:18.179 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-22T08:23:18.179 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-11-22T08:23:18.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:23:18.289 INFO:teuthology.dispatcher.supervisor:Running job 7464319
2023-11-22T08:23:18.289 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464319 --name matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi --description rados:verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464319/orig.config.yaml
2023-11-22T08:23:18.292 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464319
2023-11-22T08:23:18.293 INFO:teuthology.dispatcher.supervisor:Job PID: 3340792
2023-11-22T08:23:18.293 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-22T08:25:18.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:27:18.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:29:18.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:31:18.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:33:19.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:35:19.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:37:19.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:39:19.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:41:19.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:43:20.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:45:20.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:47:20.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:49:20.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:51:20.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:53:20.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:55:20.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:57:21.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T08:59:21.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:01:21.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:03:21.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:05:21.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:07:21.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:09:22.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:11:22.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:13:22.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:15:22.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:17:22.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:19:22.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:21:22.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:23:23.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:25:23.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:27:23.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:29:23.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:31:23.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:33:23.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:35:24.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:37:24.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:39:24.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:41:24.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:43:24.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:45:24.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:47:25.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:49:25.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:51:28.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:53:32.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:55:37.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:57:37.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T09:59:37.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:01:38.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:03:38.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:05:38.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:07:38.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:09:38.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:11:38.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:13:39.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:15:39.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:17:39.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:19:39.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:21:39.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:23:39.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:25:39.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:27:40.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:29:40.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:31:40.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:33:40.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:35:40.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:37:40.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:39:41.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:41:41.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:43:41.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:45:41.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:47:41.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:49:41.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:51:41.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:53:42.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:55:42.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:57:42.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T10:59:42.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:01:42.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:03:42.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:05:43.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:07:43.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:09:43.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:11:43.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:13:43.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:15:43.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:17:43.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:19:43.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:21:44.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:23:44.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:25:44.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:27:44.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:29:44.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:31:44.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:33:44.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:35:45.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:37:45.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:39:45.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:41:45.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:43:45.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:45:45.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:47:46.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:49:46.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:51:46.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:53:46.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:55:46.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:57:47.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T11:59:47.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T12:01:47.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-22T12:01:47.362 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-22T12:01:47.545 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-22T12:01:47.545 INFO:teuthology.nuke:Checking targets against current locks
2023-11-22T12:01:47.594 DEBUG:teuthology.nuke:shortname: smithi017
2023-11-22T12:01:47.594 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-22T12:01:47.613 DEBUG:teuthology.nuke:shortname: smithi167
2023-11-22T12:01:47.613 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-22T12:01:47.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464319', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-22 08:15:27.497282', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVmL6vbCbSfK3y/ZcUp3JbO6Uq8rhAvvEP6jYlQX7SBRNWKmHqNpZdQOb7c/JoYUcYqVkycWi3JUrH4jlMZOJs='}
2023-11-22T12:01:47.639 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464319', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-22 08:15:27.498449', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFBHKlhaOQqm6rA8ObVSdMmbjP7fvgn1gnNeWAmdmeEAQbN7FXQhsAdO1aJt6C62ZYdVH5tF/2NJSuzj5JKNYe8='}
2023-11-22T12:01:47.665 INFO:teuthology.orchestra.console.smithi017:Power off
2023-11-22T12:01:47.665 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T12:01:47.687 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2023-11-22T12:01:47.687 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T12:01:47.699 INFO:teuthology.orchestra.console.smithi167:Power off
2023-11-22T12:01:47.699 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-22T12:01:47.709 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2023-11-22T12:01:47.719 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2023-11-22T12:01:47.719 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-22T12:01:47.737 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-11-22T12:01:47.810 INFO:teuthology.orchestra.console.smithi017:Power off completed
2023-11-22T12:01:47.838 INFO:teuthology.orchestra.console.smithi167:Power off completed
2023-11-22T12:01:47.961 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2023-11-22T12:01:47.977 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com