2023-10-05T08:14:08.792 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T08:14:08.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:14:08.933 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe2fa106670>, signals=[15]) 2023-10-05T08:14:08.934 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-10-05T08:14:08.934 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T08:14:08.934 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-10-05T08:14:08.955 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-10-05T08:14:08.956 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T08:14:08.956 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-05T08:14:08.957 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-10-05T08:14:08.972 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-10-05T08:14:09.026 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-05T08:14:09.045 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-05T08:14:09.078 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3) 2023-10-05T08:14:09.078 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 3} 2023-10-05T08:14:09.086 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3) 2023-10-05T08:14:09.086 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 3} 2023-10-05T08:14:09.122 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream 2023-10-05T08:14:09.122 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:14:09.135 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream 2023-10-05T08:14:09.135 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:14:09.195 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T08:14:09.199 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T08:14:09.234 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-10-05T08:14:09.237 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-10-05T08:14:09.301 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:14:09.304 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:14:09.412 INFO:teuthology.orchestra.console.smithi107:Power off 2023-10-05T08:14:09.412 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:14:09.424 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-05T08:14:09.424 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:14:09.433 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-10-05T08:14:09.434 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:09.444 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-05T08:14:09.444 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:09.453 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-05T08:14:09.464 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-05T08:14:09.564 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-05T08:14:09.665 INFO:teuthology.orchestra.console.smithi132:Power on 2023-10-05T08:14:09.665 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T08:14:09.684 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-10-05T08:14:09.685 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:09.705 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-05T08:14:13.454 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:13.641 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-05T08:14:13.884 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:13.993 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-05T08:14:14.094 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-10-05T08:14:14.194 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-10-05T08:14:14.194 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:14:17.888 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:17.996 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-05T08:14:18.096 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-10-05T08:14:18.197 INFO:teuthology.orchestra.console.smithi107:Power on 2023-10-05T08:14:18.197 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T08:14:18.215 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-10-05T08:14:18.216 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:18.234 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-05T08:14:22.238 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:22.347 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-05T08:14:26.350 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:14:26.458 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-05T08:14:26.559 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-10-05T08:14:26.660 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-10-05T08:14:26.660 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:14:29.278 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:14:41.763 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:14:44.369 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:14:56.845 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:14:59.455 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:15:11.933 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:15:14.530 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:15:27.014 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:15:29.601 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:15:42.103 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:15:44.686 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:15:57.178 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:15:59.766 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:16:12.267 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:16:14.902 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:16:27.342 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:16:29.962 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:16:42.438 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:16:45.038 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:16:57.522 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:17:00.114 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-05T08:17:00.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:12.626 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-05T08:17:12.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:18.715 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-05T08:17:24.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:27.770 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-05T08:17:31.262 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-05T08:17:33.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:36.830 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-05T08:17:37.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:40.314 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-05T08:17:42.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:45.914 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-05T08:17:46.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:49.374 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-05T08:17:51.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:55.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:17:58.462 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-05T08:18:04.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:18:07.546 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-05T08:18:10.426 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-05T08:18:13.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:18:16.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:18:19.486 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-05T08:18:25.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:18:26.744 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T08:18:26.744 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T08:18:31.930 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-05T08:18:37.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:18:40.986 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-05T08:18:46.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:18:47.818 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T08:18:47.818 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T08:18:52.275 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-10-05T08:18:52.275 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-10-05T08:18:52.299 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-10-05T08:18:52.300 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-10-05T08:18:52.361 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-10-05T08:18:52.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-05T08:18:52.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-10-05T08:18:52.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-10-05T08:18:52.576 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-10-05T08:18:52.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-05T08:18:52.716 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-05T08:18:52.774 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-05T08:18:52.775 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-05T08:18:52.776 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-10-05T08:18:52.776 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:18:52.776 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:18:52.776 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T08:18:52.776 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-10-05T08:18:52.778 DEBUG:teuthology.parallel:result is None 2023-10-05T08:19:12.631 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-10-05T08:19:12.632 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-10-05T08:19:12.656 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-10-05T08:19:12.656 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-10-05T08:19:12.717 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-10-05T08:19:12.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-10-05T08:19:12.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-10-05T08:19:12.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-10-05T08:19:12.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-10-05T08:19:13.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-10-05T08:19:13.083 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-10-05T08:19:13.141 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-10-05T08:19:13.141 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2023-10-05T08:19:13.141 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:19:13.142 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T08:19:13.143 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-10-05T08:19:13.143 DEBUG:teuthology.parallel:result is None 2023-10-05T08:19:13.294 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-10-05T08:19:13.295 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T08:19:13.313 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-10-05T08:19:13.313 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T08:19:13.331 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-10-05T08:19:13.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-10-05T08:19:13.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:19:13.400 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-10-05T08:19:13.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-10-05T08:19:13.473 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-10-05T08:19:13.530 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-10-05T08:19:13.531 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-10-05T08:19:13.588 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-10-05T08:19:13.588 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2023-10-05T08:19:13.588 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-10-05T08:19:13.588 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-10-05T08:19:13.588 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2023-10-05T08:19:13.588 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:19:13.588 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-05T08:19:13.589 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-10-05T08:19:13.589 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-05T08:19:13.589 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-10-05T08:19:13.589 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:19:13.589 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:19:13.589 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T08:19:13.589 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-10-05T08:19:13.613 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-10-05T08:19:13.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-05T08:19:13.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:19:13.685 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-10-05T08:19:13.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-05T08:19:13.827 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-10-05T08:19:13.886 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-10-05T08:19:13.886 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-05T08:19:13.945 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-10-05T08:19:13.946 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:19:13.946 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:19:13.946 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T08:19:13.946 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-05T08:19:13.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:19:14.052 INFO:teuthology.dispatcher.supervisor:Running job 7411130 2023-10-05T08:19:14.052 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411130 --name yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-workload/new_ops/{0-clients/kclient 1-client-sanity}}} -- /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411130/orig.config.yaml 2023-10-05T08:19:14.055 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411130 2023-10-05T08:19:14.056 INFO:teuthology.dispatcher.supervisor:Job PID: 3485076 2023-10-05T08:19:14.056 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-05T08:21:14.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:23:14.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:25:14.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:27:14.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:29:14.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:31:15.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:33:15.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:35:15.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:37:15.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:39:15.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:41:15.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:43:16.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:43:16.080 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-05T08:43:16.174 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-05T08:43:16.174 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T08:43:16.218 DEBUG:teuthology.nuke:shortname: smithi107 2023-10-05T08:43:16.218 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T08:43:16.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411130', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 08:14:07.908456', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDF0oIG6XtALlBW+NNEGWLoqXt1EnJFc2/FAlEw+248OEKVGsmYkUbmxqs2gsTpcx/8bz906aLLc4qzo3TfMUk='} 2023-10-05T08:43:16.239 DEBUG:teuthology.nuke:shortname: smithi132 2023-10-05T08:43:16.239 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T08:43:16.260 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411130', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 08:14:07.906733', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIggwm+oU9eyhCtf0GbwG9gn9wjkEGr+p8rJoxo68WnrvNUF3bVMPd5AWwEsdre+hpcUCfsYdmK0CHNxRiONWCU='} 2023-10-05T08:43:16.276 INFO:teuthology.orchestra.console.smithi107:Power off 2023-10-05T08:43:16.276 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:43:16.297 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-10-05T08:43:16.297 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:43:16.310 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-05T08:43:16.310 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:43:16.317 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-05T08:43:16.329 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-05T08:43:16.329 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:43:16.348 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-05T08:43:16.419 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-10-05T08:43:16.449 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-05T08:43:16.565 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-10-05T08:43:16.589 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com