2023-08-12T16:42:16.102 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-12T16:42:16.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T16:42:16.228 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5b25c23280>, signals=[15]) 2023-08-12T16:42:16.229 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-08-12T16:42:16.230 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-08-12T16:42:16.230 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-08-12T16:42:16.254 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-08-12T16:42:16.254 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-08-12T16:42:16.254 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-08-12T16:42:16.255 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-08-12T16:42:16.270 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-08-12T16:42:16.329 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-12T16:42:16.334 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-12T16:42:16.370 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3) 2023-08-12T16:42:16.370 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 3} 2023-08-12T16:42:16.384 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_8.stream (ID 3) 2023-08-12T16:42:16.384 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 3} 2023-08-12T16:42:16.424 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream 2023-08-12T16:42:16.424 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:42:16.427 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream 2023-08-12T16:42:16.428 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:42:16.480 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-08-12T16:42:16.484 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-08-12T16:42:16.529 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-08-12T16:42:16.535 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-08-12T16:42:16.582 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:42:16.587 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:42:16.683 INFO:teuthology.orchestra.console.smithi187:Power off 2023-08-12T16:42:16.684 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-12T16:42:16.697 INFO:teuthology.orchestra.console.smithi132:Power off 2023-08-12T16:42:16.697 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-12T16:42:16.706 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-08-12T16:42:16.706 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:16.718 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-08-12T16:42:16.719 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:16.727 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-12T16:42:16.739 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-08-12T16:42:20.730 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:20.740 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:20.840 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-12T16:42:20.848 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-08-12T16:42:24.846 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:24.853 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:24.956 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-12T16:42:24.962 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-08-12T16:42:25.057 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-08-12T16:42:25.158 INFO:teuthology.orchestra.console.smithi187:Power on 2023-08-12T16:42:25.158 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-12T16:42:25.183 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-08-12T16:42:25.184 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:25.204 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-12T16:42:28.964 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:29.073 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-08-12T16:42:29.174 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-08-12T16:42:29.205 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:29.276 INFO:teuthology.orchestra.console.smithi132:Power on 2023-08-12T16:42:29.277 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-12T16:42:29.297 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-08-12T16:42:29.297 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:29.316 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-12T16:42:29.317 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-08-12T16:42:33.320 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:33.329 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:33.430 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-12T16:42:33.438 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-08-12T16:42:33.532 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-08-12T16:42:33.633 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-08-12T16:42:33.633 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:42:37.442 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T16:42:37.552 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-08-12T16:42:37.653 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-08-12T16:42:37.754 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-08-12T16:42:37.755 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:42:48.704 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:42:52.840 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:43:03.778 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:43:07.916 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:43:18.849 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:43:22.999 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:43:33.929 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:43:38.072 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:43:49.020 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:43:53.164 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:44:04.093 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:44:08.240 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:44:19.164 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:44:23.305 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:44:34.242 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:44:38.380 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:44:49.316 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:44:53.456 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:45:04.396 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:45:08.545 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-08-12T16:45:08.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:11.664 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-08-12T16:45:17.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:19.456 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-12T16:45:19.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:20.724 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-08-12T16:45:22.576 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-12T16:45:26.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:28.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:29.776 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-08-12T16:45:31.632 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-12T16:45:35.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:37.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:38.832 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-08-12T16:45:40.688 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-12T16:45:44.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:46.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:47.888 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-08-12T16:45:49.744 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-12T16:45:53.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:55.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:45:56.944 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-08-12T16:45:58.800 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-12T16:46:02.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:46:04.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:46:07.856 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-12T16:46:13.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:47:02.997 WARNING:teuthology.provision.fog.smithi132:timed out 2023-08-12T16:47:09.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:47:09.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-12T16:47:09.232 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-12T16:47:09.475 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-08-12T16:47:09.476 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-08-12T16:47:09.536 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-08-12T16:47:09.536 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-08-12T16:47:09.596 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-08-12T16:47:09.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-08-12T16:47:09.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-08-12T16:47:09.733 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-08-12T16:47:09.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-08-12T16:47:09.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-08-12T16:47:09.939 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-08-12T16:47:09.997 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-08-12T16:47:09.997 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-08-12T16:47:09.998 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-08-12T16:47:09.998 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-08-12T16:47:09.998 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-08-12T16:47:09.998 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-08-12T16:47:09.998 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-12T16:47:09.998 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-08-12T16:47:09.998 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-12T16:47:09.999 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-08-12T16:47:09.999 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-12T16:47:09.999 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-12T16:47:09.999 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-12T16:47:10.000 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-08-12T16:47:10.001 DEBUG:teuthology.parallel:result is None 2023-08-12T16:47:13.864 WARNING:teuthology.provision.fog.smithi187:timed out 2023-08-12T16:47:19.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:47:20.124 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-12T16:47:20.124 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-12T16:47:20.403 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-08-12T16:47:20.403 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-08-12T16:47:20.422 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-08-12T16:47:20.422 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-08-12T16:47:20.481 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-08-12T16:47:20.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-08-12T16:47:20.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-08-12T16:47:20.613 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-08-12T16:47:20.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-08-12T16:47:20.749 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-08-12T16:47:20.816 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-08-12T16:47:20.875 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-08-12T16:47:20.876 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-08-12T16:47:20.876 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-08-12T16:47:20.876 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-08-12T16:47:20.876 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-08-12T16:47:20.877 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-08-12T16:47:20.877 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-12T16:47:20.877 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-08-12T16:47:20.877 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-12T16:47:20.877 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-08-12T16:47:20.878 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-12T16:47:20.878 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-12T16:47:20.878 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-12T16:47:20.879 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-08-12T16:47:20.880 DEBUG:teuthology.parallel:result is None 2023-08-12T16:47:21.019 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-08-12T16:47:21.020 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-12T16:47:21.043 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-08-12T16:47:21.043 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-12T16:47:21.061 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-08-12T16:47:21.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-08-12T16:47:21.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:47:21.130 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-08-12T16:47:21.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-08-12T16:47:21.268 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-08-12T16:47:21.327 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-08-12T16:47:21.327 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-08-12T16:47:21.386 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-08-12T16:47:21.386 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-08-12T16:47:21.387 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-08-12T16:47:21.387 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-08-12T16:47:21.387 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-08-12T16:47:21.387 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-08-12T16:47:21.387 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-12T16:47:21.387 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-08-12T16:47:21.387 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-12T16:47:21.388 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-08-12T16:47:21.388 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-12T16:47:21.388 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-12T16:47:21.388 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-12T16:47:21.389 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-08-12T16:47:21.410 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-08-12T16:47:21.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-12T16:47:21.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-12T16:47:21.478 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-08-12T16:47:21.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-12T16:47:21.547 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-08-12T16:47:21.603 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-08-12T16:47:21.604 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-08-12T16:47:21.662 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-08-12T16:47:21.663 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-08-12T16:47:21.663 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-08-12T16:47:21.663 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-08-12T16:47:21.663 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-08-12T16:47:21.663 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-08-12T16:47:21.663 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-12T16:47:21.663 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-08-12T16:47:21.664 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-12T16:47:21.664 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-08-12T16:47:21.664 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-12T16:47:21.664 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-12T16:47:21.665 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-12T16:47:21.665 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-08-12T16:47:21.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T16:47:21.779 INFO:teuthology.dispatcher.supervisor:Running job 7367356 2023-08-12T16:47:21.779 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-08-12_14:23:03-upgrade:pacific-x-reef-distro-default-smithi/7367356 --name teuthology-2023-08-12_14:23:03-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-08-12_14:23:03-upgrade:pacific-x-reef-distro-default-smithi/7367356/orig.config.yaml 2023-08-12T16:47:21.783 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-08-12_14:23:03-upgrade:pacific-x-reef-distro-default-smithi/7367356 2023-08-12T16:47:21.784 INFO:teuthology.dispatcher.supervisor:Job PID: 32303 2023-08-12T16:47:21.785 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-12T16:49:21.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T16:51:22.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T16:53:23.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T16:55:23.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T16:57:23.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T16:59:23.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:01:23.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:03:24.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:05:24.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:07:24.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:09:24.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:11:25.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:13:25.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:15:27.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:17:28.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:19:28.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:21:28.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:23:28.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:25:28.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:27:28.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:29:29.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:31:29.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:33:29.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:35:29.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:37:29.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:39:29.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:41:30.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:43:30.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:45:30.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:47:30.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:49:30.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:51:30.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:53:30.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:55:31.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:57:31.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T17:59:31.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:01:31.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:03:31.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:05:31.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:07:31.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:09:32.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:11:32.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:13:32.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:15:32.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:17:32.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:19:32.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:21:33.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:23:33.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:25:33.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:27:33.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:29:33.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:31:33.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:33:34.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:35:34.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:37:34.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:39:34.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:41:34.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:43:34.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:45:35.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:47:35.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:49:35.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:51:35.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:53:35.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:55:35.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:57:36.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T18:59:36.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T19:01:36.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T19:03:36.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T19:05:36.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-12T19:05:36.751 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-12T19:05:36.989 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-12T19:05:36.989 INFO:teuthology.nuke:Checking targets against current locks 2023-08-12T19:05:37.038 DEBUG:teuthology.nuke:shortname: smithi132 2023-08-12T19:05:37.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-12T19:05:37.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-12_14:23:03-upgrade:pacific-x-reef-distro-default-smithi/7367356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-12 16:42:15.332943', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDqAxVMhf+eeL1dPElyska4Il2O+sJxPubfK+bxUDCRooqlUzSDIxP/k7NeehPh8Lu03XXb8hPVCoPSFPtqJrjo='} 2023-08-12T19:05:37.061 DEBUG:teuthology.nuke:shortname: smithi187 2023-08-12T19:05:37.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-12T19:05:37.080 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-12_14:23:03-upgrade:pacific-x-reef-distro-default-smithi/7367356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-12 16:42:15.331426', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGZE1HzSaDJuBKohZSCQAPjsbHjOLE9W+YnK5OH3cbapJNAAe3BBCVFc6nvuU+64B9OnWXsO/B3Y/esfI6OljLU='} 2023-08-12T19:05:37.095 INFO:teuthology.orchestra.console.smithi132:Power off 2023-08-12T19:05:37.096 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-12T19:05:37.115 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-08-12T19:05:37.116 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T19:05:37.136 INFO:teuthology.orchestra.console.smithi187:Power off 2023-08-12T19:05:37.137 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-12T19:05:37.146 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-08-12T19:05:37.157 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-08-12T19:05:37.158 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-12T19:05:37.178 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-12T19:05:37.247 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-08-12T19:05:37.280 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-08-12T19:05:37.400 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2023-08-12T19:05:37.424 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com