2023-11-05T00:12:09.154 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-05T00:12:09.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:12:09.312 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a4856e670>, signals=[15]) 2023-11-05T00:12:09.313 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-11-05T00:12:09.314 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T00:12:09.315 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-11-05T00:12:09.337 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-11-05T00:12:09.338 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T00:12:09.338 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-11-05T00:12:09.339 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-11-05T00:12:09.362 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"} 2023-11-05T00:12:09.412 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-05T00:12:09.442 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-05T00:12:09.448 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_9.stream (ID 10) 2023-11-05T00:12:09.448 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 10} 2023-11-05T00:12:09.485 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_9.stream (ID 10) 2023-11-05T00:12:09.485 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 10} 2023-11-05T00:12:09.494 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 9.stream 2023-11-05T00:12:09.495 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:12:09.528 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 9.stream 2023-11-05T00:12:09.528 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:12:09.545 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T00:12:09.579 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T00:12:09.582 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-11-05T00:12:09.633 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1} 2023-11-05T00:12:09.656 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:12:09.691 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:12:09.752 INFO:teuthology.orchestra.console.smithi155:Power off 2023-11-05T00:12:09.753 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:12:09.777 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-11-05T00:12:09.777 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:09.796 INFO:teuthology.orchestra.console.smithi173:Power off 2023-11-05T00:12:09.797 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:12:09.805 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-05T00:12:09.818 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-11-05T00:12:09.818 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:09.841 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-11-05T00:12:09.906 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-11-05T00:12:10.007 INFO:teuthology.orchestra.console.smithi155:Power on 2023-11-05T00:12:10.008 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T00:12:10.030 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-11-05T00:12:10.031 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:10.053 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-05T00:12:13.846 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:13.956 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-11-05T00:12:14.054 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:14.165 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-05T00:12:17.958 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:18.067 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-05T00:12:18.166 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:18.173 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-11-05T00:12:18.274 INFO:teuthology.orchestra.console.smithi173:Power on 2023-11-05T00:12:18.274 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T00:12:18.283 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-11-05T00:12:18.296 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2023-11-05T00:12:18.296 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:18.318 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-05T00:12:18.384 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-11-05T00:12:18.485 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-11-05T00:12:18.486 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:12:22.322 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:22.433 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-05T00:12:26.438 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:12:26.547 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-11-05T00:12:26.648 INFO:teuthology.orchestra.console.smithi173:Power on completed 2023-11-05T00:12:26.749 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-11-05T00:12:26.749 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:12:33.558 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:12:41.835 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:12:48.638 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:12:56.928 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:13:03.714 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:13:12.014 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:13:18.794 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:13:27.091 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:13:33.874 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:13:42.178 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:13:48.967 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:13:57.282 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:14:04.057 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:14:12.358 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:14:19.134 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:14:27.462 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:14:34.226 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:14:42.558 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:14:49.310 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:14:57.646 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-05T00:14:57.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:00.794 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:15:04.388 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-05T00:15:04.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:06.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:07.546 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-05T00:15:09.854 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:15:13.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:15.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:16.602 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-05T00:15:18.938 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:15:22.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:24.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:25.658 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-05T00:15:27.998 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:15:31.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:34.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:34.714 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-05T00:15:37.082 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:15:40.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:43.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:43.770 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-05T00:15:46.142 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:15:49.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:52.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:15:52.833 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-05T00:15:55.230 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:15:58.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:16:01.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:16:19.583 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:16:25.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:16:28.666 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-05T00:16:34.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:16:36.714 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T00:16:36.715 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T00:16:58.837 WARNING:teuthology.provision.fog.smithi155:timed out 2023-11-05T00:17:02.102 INFO:teuthology.provision.fog.smithi173:Node is ready 2023-11-05T00:17:02.103 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2023-11-05T00:17:02.161 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2023-11-05T00:17:02.162 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2023-11-05T00:17:02.218 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2023-11-05T00:17:02.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-11-05T00:17:02.351 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2023-11-05T00:17:02.381 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2023-11-05T00:17:02.452 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2023-11-05T00:17:02.521 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-11-05T00:17:02.588 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-11-05T00:17:02.643 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-11-05T00:17:02.643 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2023-11-05T00:17:02.643 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-11-05T00:17:02.643 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-11-05T00:17:02.644 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2023-11-05T00:17:02.644 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2023-11-05T00:17:02.644 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T00:17:02.644 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-11-05T00:17:02.644 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2023-11-05T00:17:02.644 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T00:17:02.645 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-11-05T00:17:02.645 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T00:17:02.645 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T00:17:02.645 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T00:17:02.646 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2023-11-05T00:17:02.648 DEBUG:teuthology.parallel:result is None 2023-11-05T00:17:04.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:17:05.052 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T00:17:05.053 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T00:17:05.406 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-11-05T00:17:05.406 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-11-05T00:17:05.421 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-11-05T00:17:05.422 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-11-05T00:17:05.477 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-11-05T00:17:05.478 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-11-05T00:17:05.602 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-11-05T00:17:05.631 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-11-05T00:17:05.699 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-11-05T00:17:05.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-11-05T00:17:05.836 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-11-05T00:17:05.891 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-11-05T00:17:05.892 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-11-05T00:17:05.892 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-11-05T00:17:05.892 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-11-05T00:17:05.893 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-11-05T00:17:05.893 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-11-05T00:17:05.893 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T00:17:05.894 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-11-05T00:17:05.894 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-11-05T00:17:05.894 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T00:17:05.895 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-11-05T00:17:05.895 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T00:17:05.896 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T00:17:05.896 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T00:17:05.897 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-11-05T00:17:05.897 DEBUG:teuthology.parallel:result is None 2023-11-05T00:17:06.066 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-11-05T00:17:06.068 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T00:17:06.086 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2023-11-05T00:17:06.086 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T00:17:06.112 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-11-05T00:17:06.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-11-05T00:17:06.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:17:06.193 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-11-05T00:17:06.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-11-05T00:17:06.261 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-11-05T00:17:06.315 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-11-05T00:17:06.316 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-11-05T00:17:06.370 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-11-05T00:17:06.370 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-11-05T00:17:06.370 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-11-05T00:17:06.370 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-11-05T00:17:06.371 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-11-05T00:17:06.371 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-11-05T00:17:06.371 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T00:17:06.371 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-11-05T00:17:06.371 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-11-05T00:17:06.372 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T00:17:06.372 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-11-05T00:17:06.372 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T00:17:06.372 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T00:17:06.372 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T00:17:06.373 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-11-05T00:17:06.420 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2023-11-05T00:17:06.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-11-05T00:17:06.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T00:17:06.503 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-11-05T00:17:06.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-11-05T00:17:06.575 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-11-05T00:17:06.632 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-11-05T00:17:06.633 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-11-05T00:17:06.689 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-11-05T00:17:06.689 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2023-11-05T00:17:06.690 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-11-05T00:17:06.690 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-11-05T00:17:06.690 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2023-11-05T00:17:06.690 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2023-11-05T00:17:06.691 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T00:17:06.691 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-11-05T00:17:06.691 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2023-11-05T00:17:06.691 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T00:17:06.691 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-11-05T00:17:06.691 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T00:17:06.692 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T00:17:06.692 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T00:17:06.692 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-11-05T00:17:06.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:17:06.809 INFO:teuthology.dispatcher.supervisor:Running job 7447401 2023-11-05T00:17:06.809 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447401 --name yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi --description fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} -- /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447401/orig.config.yaml 2023-11-05T00:17:06.813 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447401 2023-11-05T00:17:06.814 INFO:teuthology.dispatcher.supervisor:Job PID: 2423927 2023-11-05T00:17:06.814 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-05T00:19:06.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:21:07.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:23:07.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:25:07.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:27:07.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:29:07.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:31:07.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:33:08.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:35:08.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:35:08.372 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-05T00:35:08.489 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-05T00:35:08.490 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T00:35:08.538 DEBUG:teuthology.nuke:shortname: smithi155 2023-11-05T00:35:08.539 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T00:35:08.565 DEBUG:teuthology.nuke:shortname: smithi173 2023-11-05T00:35:08.566 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T00:35:08.569 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447401', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 00:12:08.312570', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE7/4E/nMN1lGH1TNMJFtw41xO3k8MGK7A8tEcUZw0KY0rwEXVe+KtpVuy5nMp9suhVo87iOSzRX8HMxxdqKsUo='} 2023-11-05T00:35:08.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447401', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 00:12:08.314005', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzGKjYw9cmRqSj3m3icfhnMIFfqQIBjqMTs2+BIvXgf/6undXqt3xH7VtXJ6CbwOLwop8Mp8FvEh8BV4VZhP18='} 2023-11-05T00:35:08.625 INFO:teuthology.orchestra.console.smithi155:Power off 2023-11-05T00:35:08.625 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:35:08.647 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-11-05T00:35:08.648 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:35:08.662 INFO:teuthology.orchestra.console.smithi173:Power off 2023-11-05T00:35:08.663 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:35:08.670 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-05T00:35:08.683 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-11-05T00:35:08.684 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:35:08.704 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-05T00:35:08.772 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-11-05T00:35:08.806 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-11-05T00:35:08.920 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2023-11-05T00:35:08.946 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com