2023-07-22T05:06:17.605 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-22T05:06:17.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:06:17.608 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:06:17.764 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa630dc58b0>, signals=[15]) 2023-07-22T05:06:17.766 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-07-22T05:06:17.766 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-07-22T05:06:17.766 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-07-22T05:06:17.795 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-07-22T05:06:17.795 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-07-22T05:06:17.795 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-07-22T05:06:17.796 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-07-22T05:06:17.819 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-07-22T05:06:17.861 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-22T05:06:17.886 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-22T05:06:17.898 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10) 2023-07-22T05:06:17.898 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 10} 2023-07-22T05:06:17.926 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_9.stream (ID 10) 2023-07-22T05:06:17.927 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 10} 2023-07-22T05:06:17.947 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream 2023-07-22T05:06:17.947 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:06:17.980 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 9.stream 2023-07-22T05:06:17.980 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:06:18.003 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-07-22T05:06:18.023 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-07-22T05:06:18.041 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-07-22T05:06:18.059 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-07-22T05:06:18.103 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:06:18.113 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:06:18.191 INFO:teuthology.orchestra.console:Power off smithi032 2023-07-22T05:06:18.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T05:06:18.211 INFO:teuthology.orchestra.console:Power off smithi104 2023-07-22T05:06:18.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T05:06:18.223 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:18.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:22.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:22.258 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:26.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:26.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:26.575 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-07-22T05:06:26.676 INFO:teuthology.orchestra.console:Power on smithi032 2023-07-22T05:06:26.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-22T05:06:26.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:30.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:30.694 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-07-22T05:06:30.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:30.796 INFO:teuthology.orchestra.console:Power on smithi104 2023-07-22T05:06:30.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-22T05:06:30.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:34.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:34.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:06:35.043 INFO:teuthology.orchestra.console:Power on for smithi032 completed 2023-07-22T05:06:35.052 INFO:teuthology.orchestra.console:Power on for smithi104 completed 2023-07-22T05:06:35.145 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-07-22T05:06:35.145 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:06:35.154 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-07-22T05:06:35.154 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:06:50.216 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:06:50.217 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:07:05.288 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:07:05.289 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:07:20.360 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:07:20.361 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:07:35.440 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:07:35.442 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:07:50.524 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:07:50.526 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:08:05.608 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:08:05.610 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:08:20.696 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:08:20.697 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:08:35.784 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:08:35.785 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:08:50.880 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:08:50.881 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-22T05:08:50.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:09:05.980 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:09:09.364 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-22T05:09:15.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:09:18.448 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-22T05:09:21.067 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-22T05:09:21.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:09:24.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:09:27.504 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-22T05:09:33.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:09:39.572 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-22T05:09:45.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:09:48.656 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-22T05:09:54.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:09:57.716 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-22T05:10:03.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:10:06.800 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-22T05:10:12.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:10:15.856 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-22T05:10:21.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:10:33.521 WARNING:teuthology.provision.fog.smithi032:timed out 2023-07-22T05:10:39.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:10:39.743 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-22T05:10:39.744 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-22T05:10:40.067 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-07-22T05:10:40.067 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-07-22T05:10:40.082 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-07-22T05:10:40.082 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-07-22T05:10:40.138 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-07-22T05:10:40.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-07-22T05:10:40.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-07-22T05:10:40.305 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-07-22T05:10:40.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-07-22T05:10:40.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-07-22T05:10:40.517 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-07-22T05:10:40.572 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2023-07-22T05:10:40.572 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2023-07-22T05:10:40.572 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2023-07-22T05:10:40.572 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2023-07-22T05:10:40.573 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T05:10:40.574 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T05:10:40.574 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T05:10:40.574 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-07-22T05:10:40.576 DEBUG:teuthology.parallel:result is None 2023-07-22T05:11:21.904 WARNING:teuthology.provision.fog.smithi104:timed out 2023-07-22T05:11:27.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:11:28.349 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-22T05:11:28.350 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-22T05:11:28.666 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-07-22T05:11:28.666 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-07-22T05:11:28.681 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-07-22T05:11:28.681 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-07-22T05:11:28.736 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-07-22T05:11:28.736 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-22T05:11:28.869 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-07-22T05:11:28.897 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-07-22T05:11:28.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-07-22T05:11:29.030 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-22T05:11:29.097 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-07-22T05:11:29.151 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-07-22T05:11:29.151 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2023-07-22T05:11:29.151 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-07-22T05:11:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-07-22T05:11:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2023-07-22T05:11:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2023-07-22T05:11:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T05:11:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-07-22T05:11:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2023-07-22T05:11:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T05:11:29.153 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-07-22T05:11:29.153 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T05:11:29.153 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T05:11:29.153 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T05:11:29.153 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-07-22T05:11:29.154 DEBUG:teuthology.parallel:result is None 2023-07-22T05:11:29.337 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-07-22T05:11:29.338 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-22T05:11:29.362 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-07-22T05:11:29.362 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-22T05:11:29.380 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-07-22T05:11:29.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-07-22T05:11:29.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:11:29.479 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-07-22T05:11:29.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-07-22T05:11:29.668 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-07-22T05:11:29.722 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-07-22T05:11:29.723 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-07-22T05:11:29.777 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2023-07-22T05:11:29.778 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2023-07-22T05:11:29.778 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2023-07-22T05:11:29.778 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2023-07-22T05:11:29.778 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2023-07-22T05:11:29.778 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T05:11:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T05:11:29.780 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-07-22T05:11:29.832 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-07-22T05:11:29.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-07-22T05:11:29.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T05:11:29.914 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-07-22T05:11:29.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-07-22T05:11:29.958 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-07-22T05:11:30.012 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-07-22T05:11:30.012 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-07-22T05:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-07-22T05:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2023-07-22T05:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-07-22T05:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-07-22T05:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2023-07-22T05:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2023-07-22T05:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T05:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-07-22T05:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2023-07-22T05:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T05:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-07-22T05:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T05:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T05:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T05:11:30.068 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-07-22T05:11:30.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:11:30.088 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:11:30.194 INFO:teuthology.dispatcher.supervisor:Running job 7347184 2023-07-22T05:11:30.195 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347184 --name yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} -- /home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347184/orig.config.yaml 2023-07-22T05:11:30.198 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347184 2023-07-22T05:11:30.199 INFO:teuthology.dispatcher.supervisor:Job PID: 28301 2023-07-22T05:11:30.199 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-22T05:13:30.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:13:30.301 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:15:30.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:15:30.474 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:17:30.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:17:30.648 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:19:30.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:19:30.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:21:30.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:21:30.997 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:23:31.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:23:31.175 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:25:31.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:25:31.342 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:27:31.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:27:31.509 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:29:31.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T05:29:31.677 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T05:29:31.759 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-22T05:29:31.875 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-22T05:29:31.875 INFO:teuthology.nuke:Checking targets against current locks 2023-07-22T05:29:31.939 DEBUG:teuthology.nuke:shortname: smithi032 2023-07-22T05:29:31.940 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T05:29:31.959 DEBUG:teuthology.nuke:shortname: smithi104 2023-07-22T05:29:31.959 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T05:29:31.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 05:06:16.778481', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPvuTJjh7UUB1YSPDF7yDw0C1asRWWMfCS9tZV2W1HQ/TI7bSL9NH+mNiL140o8g6QJ6EkTZYrYq3eG8BtazEg='} 2023-07-22T05:29:31.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 05:06:16.776673', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBgnX9mRFuki6WjR/nwxSKnFRsI1ciZ4k0O2MhdCAMG8EHtcibrzUkOC0ZqrxgtLB0fG09g8WYThmQucktRid5A='} 2023-07-22T05:29:32.016 INFO:teuthology.orchestra.console:Power off smithi032 2023-07-22T05:29:32.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T05:29:32.031 INFO:teuthology.orchestra.console:Power off smithi104 2023-07-22T05:29:32.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T05:29:32.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:29:32.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T05:29:32.164 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-07-22T05:29:32.175 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-07-22T05:29:32.323 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-07-22T05:29:32.332 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com