2023-09-05T15:30:18.195 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-05T15:30:18.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:30:18.332 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f077c9d5ca0>, signals=[15]) 2023-09-05T15:30:18.334 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-09-05T15:30:18.334 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T15:30:18.335 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-09-05T15:30:18.359 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-09-05T15:30:18.359 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T15:30:18.360 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-05T15:30:18.361 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-09-05T15:30:18.384 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-09-05T15:30:18.432 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-05T15:30:18.458 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-05T15:30:18.469 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2023-09-05T15:30:18.469 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 10} 2023-09-05T15:30:18.498 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10) 2023-09-05T15:30:18.498 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 10} 2023-09-05T15:30:18.515 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2023-09-05T15:30:18.516 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:30:18.541 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream 2023-09-05T15:30:18.541 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:30:18.589 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T15:30:18.605 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T15:30:18.636 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-09-05T15:30:18.646 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-09-05T15:30:18.712 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:30:18.715 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:30:18.831 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-05T15:30:18.832 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T15:30:18.844 INFO:teuthology.orchestra.console.smithi003:Power off 2023-09-05T15:30:18.845 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T15:30:18.853 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-05T15:30:18.854 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:18.865 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-09-05T15:30:18.866 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:18.875 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-05T15:30:18.887 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-05T15:30:22.881 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:22.888 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:22.990 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-05T15:30:22.999 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-05T15:30:26.996 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:27.003 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:27.105 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-05T15:30:27.111 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-05T15:30:27.207 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-05T15:30:27.308 INFO:teuthology.orchestra.console.smithi103:Power on 2023-09-05T15:30:27.308 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T15:30:27.328 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-09-05T15:30:27.329 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:27.350 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-05T15:30:31.116 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:31.224 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-05T15:30:31.325 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-09-05T15:30:31.351 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:31.426 INFO:teuthology.orchestra.console.smithi003:Power on 2023-09-05T15:30:31.427 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T15:30:31.448 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-09-05T15:30:31.449 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:31.460 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-05T15:30:31.468 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-05T15:30:35.462 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:35.469 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:35.571 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-05T15:30:35.577 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-05T15:30:35.673 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-09-05T15:30:35.774 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-09-05T15:30:35.774 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:30:39.582 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T15:30:39.690 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-05T15:30:39.791 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-09-05T15:30:39.892 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-09-05T15:30:39.893 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:30:50.862 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:30:54.970 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:31:05.954 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:31:10.054 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:31:21.042 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:31:25.134 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:31:36.134 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:31:40.218 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:31:51.224 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:31:55.294 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:32:06.318 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:32:10.370 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:32:21.414 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:32:25.430 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:32:36.494 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:32:40.506 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:32:51.566 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:32:55.586 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:33:06.667 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:33:10.654 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-05T15:33:10.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:13.786 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-05T15:33:19.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:21.738 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-05T15:33:21.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:22.842 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-05T15:33:24.858 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:33:28.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:30.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:31.902 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-05T15:33:33.918 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:33:37.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:39.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:40.986 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-05T15:33:43.006 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:33:46.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:49.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:50.042 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-05T15:33:52.062 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:33:56.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:33:58.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:34:01.150 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:34:07.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:34:10.234 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:34:16.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:34:19.290 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:34:25.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:34:28.346 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:34:34.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:34:52.826 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:34:56.050 WARNING:teuthology.provision.fog.smithi003:timed out 2023-09-05T15:34:58.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:35:01.882 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:35:02.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:35:02.286 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T15:35:02.287 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T15:35:02.619 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-09-05T15:35:02.619 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-09-05T15:35:02.635 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-09-05T15:35:02.635 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-09-05T15:35:02.690 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-09-05T15:35:02.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-09-05T15:35:02.791 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-09-05T15:35:02.824 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-09-05T15:35:02.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-09-05T15:35:02.966 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-09-05T15:35:03.037 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-09-05T15:35:03.093 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-09-05T15:35:03.093 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-09-05T15:35:03.094 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-09-05T15:35:03.094 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-09-05T15:35:03.095 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-09-05T15:35:03.095 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-09-05T15:35:03.095 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T15:35:03.096 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-09-05T15:35:03.096 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-09-05T15:35:03.096 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T15:35:03.097 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-09-05T15:35:03.097 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T15:35:03.098 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T15:35:03.098 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T15:35:03.099 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-09-05T15:35:03.101 DEBUG:teuthology.parallel:result is None 2023-09-05T15:35:07.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:35:10.938 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-05T15:35:16.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:35:17.214 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T15:35:17.214 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T15:35:37.604 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-09-05T15:35:37.605 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-09-05T15:35:37.624 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-09-05T15:35:37.624 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-09-05T15:35:37.681 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-09-05T15:35:37.682 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-05T15:35:37.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-09-05T15:35:37.843 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-09-05T15:35:37.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-09-05T15:35:37.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-05T15:35:38.049 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-05T15:35:38.104 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-09-05T15:35:38.105 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2023-09-05T15:35:38.105 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-09-05T15:35:38.105 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-09-05T15:35:38.105 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2023-09-05T15:35:38.106 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2023-09-05T15:35:38.106 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T15:35:38.106 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-05T15:35:38.106 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2023-09-05T15:35:38.106 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T15:35:38.107 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-09-05T15:35:38.107 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T15:35:38.107 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T15:35:38.107 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T15:35:38.108 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-09-05T15:35:38.108 DEBUG:teuthology.parallel:result is None 2023-09-05T15:35:38.296 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-09-05T15:35:38.297 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T15:35:38.323 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-09-05T15:35:38.323 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T15:35:38.340 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-09-05T15:35:38.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-09-05T15:35:38.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:35:38.438 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-09-05T15:35:38.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-09-05T15:35:38.624 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-09-05T15:35:38.680 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-09-05T15:35:38.680 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-09-05T15:35:38.735 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-09-05T15:35:38.735 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-09-05T15:35:38.736 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-09-05T15:35:38.736 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-09-05T15:35:38.736 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-09-05T15:35:38.736 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-09-05T15:35:38.736 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T15:35:38.737 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-09-05T15:35:38.737 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-09-05T15:35:38.737 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T15:35:38.737 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-09-05T15:35:38.737 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T15:35:38.737 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T15:35:38.738 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T15:35:38.738 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-09-05T15:35:38.756 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-09-05T15:35:38.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-05T15:35:38.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T15:35:38.843 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-09-05T15:35:38.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-05T15:35:38.915 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-09-05T15:35:38.971 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-09-05T15:35:38.971 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-05T15:35:39.028 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-09-05T15:35:39.028 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2023-09-05T15:35:39.028 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-09-05T15:35:39.028 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-09-05T15:35:39.029 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2023-09-05T15:35:39.029 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2023-09-05T15:35:39.029 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T15:35:39.029 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-05T15:35:39.029 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2023-09-05T15:35:39.030 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T15:35:39.030 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-09-05T15:35:39.030 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T15:35:39.030 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T15:35:39.030 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T15:35:39.031 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-05T15:35:39.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:35:39.143 INFO:teuthology.dispatcher.supervisor:Running job 7388610 2023-09-05T15:35:39.143 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_dang@sidious.arb.redhat.com --archive /home/teuthworker/archive/dang-2023-09-05_09:25:58-rgw-wip-dang-posix-driver-distro-default-smithi/7388610 --name dang-2023-09-05_09:25:58-rgw-wip-dang-posix-driver-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/dang-2023-09-05_09:25:58-rgw-wip-dang-posix-driver-distro-default-smithi/7388610/orig.config.yaml 2023-09-05T15:35:39.147 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dang-2023-09-05_09:25:58-rgw-wip-dang-posix-driver-distro-default-smithi/7388610 2023-09-05T15:35:39.147 INFO:teuthology.dispatcher.supervisor:Job PID: 2980336 2023-09-05T15:35:39.147 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-05T15:37:39.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:39:39.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:41:39.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:43:39.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:45:39.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:47:40.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:49:40.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:51:40.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:53:40.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:55:40.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:57:40.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T15:59:41.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:01:41.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:03:41.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:05:41.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:07:41.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:09:41.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:11:42.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:13:42.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:15:42.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:17:42.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:19:42.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:21:42.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:23:43.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:25:43.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:27:43.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:29:43.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:31:43.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:33:43.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:35:43.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:37:44.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:39:44.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T16:39:44.242 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-05T16:39:44.426 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-05T16:39:44.427 INFO:teuthology.nuke:Checking targets against current locks 2023-09-05T16:39:44.473 DEBUG:teuthology.nuke:shortname: smithi003 2023-09-05T16:39:44.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T16:39:44.499 DEBUG:teuthology.nuke:shortname: smithi103 2023-09-05T16:39:44.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T16:39:44.502 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dang-2023-09-05_09:25:58-rgw-wip-dang-posix-driver-distro-default-smithi/7388610', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 15:30:17.391622', 'locked_by': 'scheduled_dang@sidious.arb.redhat.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBsXRraZ+jKXX+MuFa/eRkj5v7ulpreSd0ksRVrM078P0i5c2/2Llq3KgHfe/hbiYS/kr51OPnrq6nD068SpldU='} 2023-09-05T16:39:44.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dang-2023-09-05_09:25:58-rgw-wip-dang-posix-driver-distro-default-smithi/7388610', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 15:30:17.390022', 'locked_by': 'scheduled_dang@sidious.arb.redhat.com', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLkLi4wOd5CBlfAO1R4puYrkGIFhsoxgukd3+NRmibyhsrg28S8p75EoRWMsQunl1AV4VIw8SWVw7/deBITu/DTktwQfSw9q5ph4yTUascQeAfoXAmo9XTHFuF75Wk/kj0h4+kkyCGPmm4Z4kJVWF45U3wo4ucRSkZOZqe3ZAy5CW4oePq7V+cm8IUklXR8GVWp8+zSlq4yagK6tYGV64PG6iIFmGuhHc0kv/EKEXLGSB6l+5U6AZoJvBC5tUoKq03kT6I+MV/sRZ1lNiJar06RHWGZrstWYGsqE1KoIhZXq0iFPRm32oDyWk9czx2fMmae+6lToGKj0yK0O/j0lRWPSn2VeBpVxkMdXAkmPNmQ5e1xwW1+2Zuf6vcP5CY5hWIt/3KRcfIDwz8rSrZsgQ1JyJjc+P7+2DAXBGrdgj/8beyfQ9tWmrfOQJIJIAN/JGBO8/MN27RFSSiFJVTL62OuIyNKnQESXRB7HCfwvtICWL7aDU0/TMdxoFQ+wfzx5k='} 2023-09-05T16:39:44.550 INFO:teuthology.orchestra.console.smithi003:Power off 2023-09-05T16:39:44.550 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T16:39:44.571 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-09-05T16:39:44.572 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T16:39:44.584 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-05T16:39:44.585 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T16:39:44.594 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-05T16:39:44.607 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-05T16:39:44.607 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T16:39:44.627 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-05T16:39:44.696 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-09-05T16:39:44.728 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-05T16:39:44.849 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-09-05T16:39:44.874 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com