2023-10-14T16:16:54.976 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T16:16:54.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:16:55.117 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc9db5e6670>, signals=[15]) 2023-10-14T16:16:55.119 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-10-14T16:16:55.119 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T16:16:55.119 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-10-14T16:16:55.138 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-10-14T16:16:55.138 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T16:16:55.139 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-14T16:16:55.140 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"} 2023-10-14T16:16:55.163 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-10-14T16:16:55.214 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-14T16:16:55.235 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-14T16:16:55.258 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10) 2023-10-14T16:16:55.258 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 10} 2023-10-14T16:16:55.280 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_9.stream (ID 10) 2023-10-14T16:16:55.281 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 10} 2023-10-14T16:16:55.306 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream 2023-10-14T16:16:55.306 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:16:55.325 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 9.stream 2023-10-14T16:16:55.326 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:16:55.378 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T16:16:55.385 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T16:16:55.417 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1} 2023-10-14T16:16:55.422 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-10-14T16:16:55.468 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:16:55.483 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:16:55.574 INFO:teuthology.orchestra.console.smithi029:Power off 2023-10-14T16:16:55.574 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T16:16:55.585 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-14T16:16:55.585 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T16:16:55.599 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-10-14T16:16:55.601 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:16:55.612 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-14T16:16:55.613 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:16:55.627 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-14T16:16:55.634 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-14T16:16:59.630 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:16:59.637 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:16:59.739 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-14T16:16:59.745 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-14T16:17:03.743 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:03.750 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:03.852 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-14T16:17:03.858 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-14T16:17:07.854 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:07.860 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:07.963 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-10-14T16:17:07.969 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-14T16:17:08.064 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-10-14T16:17:08.070 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-14T16:17:08.165 INFO:teuthology.orchestra.console.smithi029:Power on 2023-10-14T16:17:08.165 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T16:17:08.173 INFO:teuthology.orchestra.console.smithi186:Power on 2023-10-14T16:17:08.174 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T16:17:08.189 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2023-10-14T16:17:08.190 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:08.201 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-10-14T16:17:08.201 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:08.213 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-10-14T16:17:08.223 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-14T16:17:12.218 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:12.225 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:12.327 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-10-14T16:17:12.335 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-14T16:17:16.330 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:16.337 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T16:17:16.440 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-14T16:17:16.446 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-14T16:17:16.541 INFO:teuthology.orchestra.console.smithi029:Power on completed 2023-10-14T16:17:16.548 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-10-14T16:17:16.642 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-10-14T16:17:16.643 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:17:16.648 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-10-14T16:17:16.649 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:17:31.720 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:17:31.722 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:17:46.822 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:17:46.824 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:18:01.900 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:18:01.915 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:18:16.988 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:18:16.990 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:18:32.066 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:18:32.067 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:18:47.166 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:18:47.169 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:19:02.274 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:19:02.276 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:19:17.378 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:19:17.380 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:19:32.462 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:19:32.464 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:19:47.554 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:19:47.556 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-14T16:19:47.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:19:47.707 ERROR:teuthology.orchestra.connection:Error authenticating with smithi186.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-14T16:20:02.638 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:20:17.701 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-10-14T16:20:17.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:20:20.862 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-14T16:20:26.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:20:29.946 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-14T16:20:35.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:20:39.006 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-14T16:20:45.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:20:48.062 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-14T16:20:51.712 WARNING:teuthology.provision.fog.smithi186:timed out 2023-10-14T16:20:54.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:20:57.114 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-14T16:20:57.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:21:03.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:21:16.282 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-14T16:21:22.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:21:25.342 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-14T16:21:31.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:21:34.398 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-14T16:21:40.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:21:40.778 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T16:21:40.779 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T16:21:56.238 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-10-14T16:21:56.238 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-10-14T16:21:56.294 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-10-14T16:21:56.295 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-10-14T16:21:56.352 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-10-14T16:21:56.353 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-14T16:21:56.471 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-10-14T16:21:56.500 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-10-14T16:21:56.568 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-10-14T16:21:56.637 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-14T16:21:56.705 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-14T16:21:56.760 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-10-14T16:21:56.760 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2023-10-14T16:21:56.760 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-10-14T16:21:56.761 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-10-14T16:21:56.761 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2023-10-14T16:21:56.761 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2023-10-14T16:21:56.761 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T16:21:56.761 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-14T16:21:56.762 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2023-10-14T16:21:56.762 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T16:21:56.762 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-10-14T16:21:56.762 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T16:21:56.762 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T16:21:56.763 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T16:21:56.763 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-10-14T16:21:56.765 DEBUG:teuthology.parallel:result is None 2023-10-14T16:22:03.119 WARNING:teuthology.provision.fog.smithi029:timed out 2023-10-14T16:22:09.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:22:09.469 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T16:22:09.469 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T16:22:09.824 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-10-14T16:22:09.824 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2023-10-14T16:22:09.839 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-10-14T16:22:09.839 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2023-10-14T16:22:09.895 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-10-14T16:22:09.896 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-10-14T16:22:10.045 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2023-10-14T16:22:10.076 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2023-10-14T16:22:10.147 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2023-10-14T16:22:10.218 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-10-14T16:22:10.289 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-10-14T16:22:10.344 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-10-14T16:22:10.344 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2023-10-14T16:22:10.345 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-10-14T16:22:10.345 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-10-14T16:22:10.345 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2023-10-14T16:22:10.345 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2023-10-14T16:22:10.345 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T16:22:10.346 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-10-14T16:22:10.347 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2023-10-14T16:22:10.348 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T16:22:10.348 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-10-14T16:22:10.348 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T16:22:10.348 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T16:22:10.348 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T16:22:10.349 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-10-14T16:22:10.349 DEBUG:teuthology.parallel:result is None 2023-10-14T16:22:10.518 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-10-14T16:22:10.519 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-14T16:22:10.542 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-10-14T16:22:10.542 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-14T16:22:10.560 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-10-14T16:22:10.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-14T16:22:10.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:22:10.657 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-14T16:22:10.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-14T16:22:10.725 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-10-14T16:22:10.779 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-10-14T16:22:10.779 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-10-14T16:22:10.834 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-10-14T16:22:10.834 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2023-10-14T16:22:10.834 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-10-14T16:22:10.835 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-10-14T16:22:10.835 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2023-10-14T16:22:10.835 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2023-10-14T16:22:10.835 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T16:22:10.835 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-10-14T16:22:10.836 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2023-10-14T16:22:10.836 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T16:22:10.836 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-10-14T16:22:10.836 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T16:22:10.836 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T16:22:10.836 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T16:22:10.837 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-10-14T16:22:10.858 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-10-14T16:22:10.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-14T16:22:10.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:22:10.940 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-10-14T16:22:11.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-14T16:22:11.117 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-10-14T16:22:11.171 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-10-14T16:22:11.171 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-14T16:22:11.225 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-10-14T16:22:11.225 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2023-10-14T16:22:11.225 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-10-14T16:22:11.225 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-10-14T16:22:11.226 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2023-10-14T16:22:11.226 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2023-10-14T16:22:11.226 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T16:22:11.226 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-14T16:22:11.227 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2023-10-14T16:22:11.227 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T16:22:11.227 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-10-14T16:22:11.227 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T16:22:11.227 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T16:22:11.228 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T16:22:11.228 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-14T16:22:11.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:22:11.342 INFO:teuthology.dispatcher.supervisor:Running job 7427857 2023-10-14T16:22:11.343 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-10-14_16:12:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7427857 --name mchangir-2023-10-14_16:12:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-10-14_16:12:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7427857/orig.config.yaml 2023-10-14T16:22:11.347 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-10-14_16:12:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7427857 2023-10-14T16:22:11.347 INFO:teuthology.dispatcher.supervisor:Job PID: 3093715 2023-10-14T16:22:11.348 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-14T16:24:11.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:26:11.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:28:11.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:30:11.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:32:11.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:34:11.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:36:11.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:38:11.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:40:11.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:42:11.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:44:12.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:46:12.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:48:12.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:50:12.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:52:12.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:54:12.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:56:12.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:58:12.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:00:12.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:02:12.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:04:12.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:06:12.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:08:12.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:10:12.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:12:13.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:14:13.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:16:13.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:18:13.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:20:13.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:22:13.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:24:13.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:26:13.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:28:13.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:30:13.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:32:13.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:34:13.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:36:13.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:38:13.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:40:13.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:42:14.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:44:14.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:46:14.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:48:14.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:50:14.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:52:14.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:54:14.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:56:14.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:58:14.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:00:14.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:02:14.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:04:14.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:06:14.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:08:14.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:10:14.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:12:15.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:14:15.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:16:15.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:18:15.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:20:15.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:22:15.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:22:15.450 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-14T18:22:15.628 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-14T18:22:15.628 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T18:22:15.680 DEBUG:teuthology.nuke:shortname: smithi029 2023-10-14T18:22:15.681 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T18:22:15.702 DEBUG:teuthology.nuke:shortname: smithi186 2023-10-14T18:22:15.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T18:22:15.707 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-10-14_16:12:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7427857', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:16:54.151268', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIenUNMjS8jLbCKDUoA7LlCVAfZYMnpf8GelG1yGs0Dgy+1xDbuTILZXW1iFdqKmiHAbnH8lIKg+zsbMUw3XwYQ='} 2023-10-14T18:22:15.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-10-14_16:12:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7427857', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:16:54.149741', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPU6xheaByxOWomGjN7eaKx5atbspCF5BwcdL4eoU8q6q3asLPy0dBw6fYz2uLTcrEYRjiqWnzO8he55rz4DVHM='} 2023-10-14T18:22:15.754 INFO:teuthology.orchestra.console.smithi029:Power off 2023-10-14T18:22:15.755 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T18:22:15.780 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-10-14T18:22:15.781 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:22:15.798 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-14T18:22:15.798 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T18:22:15.807 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-10-14T18:22:15.818 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-14T18:22:15.819 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:22:15.844 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-14T18:22:15.908 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-10-14T18:22:15.946 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-14T18:22:16.073 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-10-14T18:22:16.107 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com