2023-07-14T04:18:30.596 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-14T04:18:30.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:18:30.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:18:55.595 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b35be68b0>, signals=[15]) 2023-07-14T04:18:55.597 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-07-14T04:18:55.597 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:18:55.597 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-07-14T04:19:00.608 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-07-14T04:19:00.608 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:19:00.609 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-14T04:19:00.610 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-07-14T04:19:10.649 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-07-14T04:19:20.687 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T04:19:30.708 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T04:19:35.714 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T04:19:35.714 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 10} 2023-07-14T04:19:35.790 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T04:19:35.790 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 10} 2023-07-14T04:19:40.792 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2023-07-14T04:19:40.792 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-07-14T04:19:45.838 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream 2023-07-14T04:19:45.839 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T04:19:50.846 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:19:55.901 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-07-14T04:20:00.565 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:20:00.618 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-07-14T04:20:05.626 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-07-14T04:20:05.776 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T04:20:12.748 INFO:teuthology.orchestra.console:Power off smithi064 2023-07-14T04:20:12.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:20:12.772 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-14T04:20:12.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:20:12.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:12.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:16.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:16.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:20.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:20.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:26.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:26.046 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:31.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:31.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:31.361 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-07-14T04:20:31.371 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-14T04:20:31.463 INFO:teuthology.orchestra.console:Power on smithi064 2023-07-14T04:20:31.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:20:31.473 INFO:teuthology.orchestra.console:Power on smithi154 2023-07-14T04:20:31.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:20:36.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:36.502 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:41.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:41.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:46.618 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:46.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:51.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:51.737 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:56.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:20:56.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:01.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:01.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:07.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:07.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:12.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:12.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:17.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:17.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:22.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:22.425 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:27.528 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:27.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:32.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:32.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:37.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:37.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:37.971 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2023-07-14T04:21:38.072 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-07-14T04:21:38.072 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T04:21:38.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:21:41.168 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T04:21:42.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:21:43.071 INFO:teuthology.orchestra.console:Power on for smithi064 completed 2023-07-14T04:21:43.172 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-07-14T04:21:43.173 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-07-14T04:21:43.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:21:46.288 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-07-14T04:21:47.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:21:52.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:22:52.234 WARNING:teuthology.provision.fog.smithi154:timed out 2023-07-14T04:22:52.293 WARNING:teuthology.provision.fog.smithi064:timed out 2023-07-14T04:22:58.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:22:58.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:22:58.548 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:22:58.549 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:22:58.652 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:22:58.653 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:22:58.948 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-07-14T04:22:58.949 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-07-14T04:22:58.964 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-07-14T04:22:58.965 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-07-14T04:22:59.005 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-07-14T04:22:59.005 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-07-14T04:22:59.020 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-07-14T04:22:59.020 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-07-14T04:22:59.021 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-07-14T04:22:59.021 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-07-14T04:22:59.074 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-07-14T04:22:59.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-07-14T04:22:59.149 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-07-14T04:22:59.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-07-14T04:22:59.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-07-14T04:22:59.254 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-07-14T04:22:59.267 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-07-14T04:22:59.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-07-14T04:22:59.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-07-14T04:22:59.397 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-07-14T04:22:59.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-07-14T04:22:59.452 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-07-14T04:22:59.452 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-07-14T04:22:59.453 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-07-14T04:22:59.453 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-07-14T04:22:59.453 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-07-14T04:22:59.453 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-07-14T04:22:59.453 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T04:22:59.454 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-07-14T04:22:59.454 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-07-14T04:22:59.454 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T04:22:59.454 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-07-14T04:22:59.454 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T04:22:59.455 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T04:22:59.455 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T04:22:59.456 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-07-14T04:22:59.458 DEBUG:teuthology.parallel:result is None 2023-07-14T04:22:59.470 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-14T04:22:59.531 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-07-14T04:22:59.532 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2023-07-14T04:22:59.532 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-07-14T04:22:59.532 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-07-14T04:22:59.532 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2023-07-14T04:22:59.532 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2023-07-14T04:22:59.532 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T04:22:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-07-14T04:22:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2023-07-14T04:22:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T04:22:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-07-14T04:22:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T04:22:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T04:22:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T04:22:59.534 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-07-14T04:22:59.534 DEBUG:teuthology.parallel:result is None 2023-07-14T04:23:14.697 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-07-14T04:23:14.698 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-07-14T04:23:14.700 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-07-14T04:23:14.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-07-14T04:23:14.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:23:14.796 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-07-14T04:23:14.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-07-14T04:23:14.995 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-07-14T04:23:15.049 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-07-14T04:23:15.049 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-07-14T04:23:15.103 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-07-14T04:23:15.103 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-07-14T04:23:15.103 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-07-14T04:23:15.103 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-07-14T04:23:15.103 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-07-14T04:23:15.104 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-07-14T04:23:15.104 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T04:23:15.104 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-07-14T04:23:15.104 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-07-14T04:23:15.104 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T04:23:15.104 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-07-14T04:23:15.104 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T04:23:15.105 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T04:23:15.105 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T04:23:15.105 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-07-14T04:23:20.148 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-07-14T04:23:20.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T04:23:20.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:23:20.236 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-07-14T04:23:20.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T04:23:20.419 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-07-14T04:23:20.473 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-07-14T04:23:20.473 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-14T04:23:20.527 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-07-14T04:23:20.528 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2023-07-14T04:23:20.528 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-07-14T04:23:20.528 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-07-14T04:23:20.528 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2023-07-14T04:23:20.528 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T04:23:20.529 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T04:23:20.530 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-14T04:23:23.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:23:23.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:23:28.383 INFO:teuthology.dispatcher.supervisor:Running job 7336954 2023-07-14T04:23:28.384 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336954 --name yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} -- /home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336954/orig.config.yaml 2023-07-14T04:23:28.388 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336954 2023-07-14T04:23:28.388 INFO:teuthology.dispatcher.supervisor:Job PID: 1571 2023-07-14T04:23:28.389 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-14T04:25:28.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:25:28.491 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:27:33.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:27:33.674 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:29:35.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:29:35.044 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:29:40.115 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T04:29:43.370 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T04:29:43.370 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T04:29:43.420 DEBUG:teuthology.nuke:shortname: smithi064 2023-07-14T04:29:43.421 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:29:43.440 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:18:29.733824', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwqQTwUqvXhce1H7vRoB8Cm9F+ZiGR4BzBDeQ4bfaRqxYYj4scteLhBh2bE1i1ivewts0uB8chN93um7ph4MuA='} 2023-07-14T04:29:43.443 DEBUG:teuthology.nuke:shortname: smithi154 2023-07-14T04:29:43.443 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:29:43.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:18:29.732167', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF9ZiTzXkL0QsvHnyhQbimtpYjH1R4uB/y9grIA0jxiYc9i9IsMHWpYWcwTva0n8Khd+FCitD2r5Sj6RQ0dxFQk='} 2023-07-14T04:29:43.494 INFO:teuthology.orchestra.console:Power off smithi064 2023-07-14T04:29:43.495 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:29:43.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:29:43.542 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-14T04:29:43.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:29:43.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:29:43.652 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-07-14T04:29:43.688 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-14T04:29:53.826 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-07-14T04:29:53.847 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com