2023-11-08T17:33:15.204 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T17:33:15.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:33:15.355 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f04e3336670>, signals=[15]) 2023-11-08T17:33:15.356 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-11-08T17:33:15.356 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T17:33:15.357 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-11-08T17:33:15.378 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-11-08T17:33:15.379 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T17:33:15.379 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-08T17:33:15.380 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-11-08T17:33:15.403 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-11-08T17:33:15.468 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-08T17:33:15.480 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-08T17:33:15.511 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_9.stream (ID 10) 2023-11-08T17:33:15.512 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 10} 2023-11-08T17:33:15.523 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10) 2023-11-08T17:33:15.523 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 10} 2023-11-08T17:33:15.559 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 9.stream 2023-11-08T17:33:15.560 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:33:15.572 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream 2023-11-08T17:33:15.572 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:33:15.629 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T17:33:15.633 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T17:33:15.672 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-11-08T17:33:15.681 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-11-08T17:33:15.731 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:33:15.741 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:33:15.829 INFO:teuthology.orchestra.console.smithi192:Power off 2023-11-08T17:33:15.830 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T17:33:15.847 INFO:teuthology.orchestra.console.smithi155:Power off 2023-11-08T17:33:15.848 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T17:33:15.855 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-11-08T17:33:15.856 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:15.870 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-11-08T17:33:15.870 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:15.879 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-08T17:33:15.900 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-11-08T17:33:19.882 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:19.901 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:19.991 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-08T17:33:20.010 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-11-08T17:33:23.994 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:24.012 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:24.104 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-08T17:33:24.121 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-08T17:33:24.222 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-11-08T17:33:24.323 INFO:teuthology.orchestra.console.smithi155:Power on 2023-11-08T17:33:24.324 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T17:33:24.347 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-11-08T17:33:24.348 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:24.370 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-08T17:33:28.106 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:28.215 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-08T17:33:28.316 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-11-08T17:33:28.371 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:28.418 INFO:teuthology.orchestra.console.smithi192:Power on 2023-11-08T17:33:28.418 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T17:33:28.440 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-11-08T17:33:28.441 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:28.462 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-08T17:33:28.481 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-08T17:33:32.466 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:32.482 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T17:33:32.575 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-08T17:33:32.592 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-11-08T17:33:32.677 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-11-08T17:33:32.693 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-11-08T17:33:32.778 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-11-08T17:33:32.779 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:33:32.795 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-11-08T17:33:32.795 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:33:47.850 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:33:47.854 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:34:02.922 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:34:02.924 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:34:18.001 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:34:18.003 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:34:33.066 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:34:33.068 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:34:48.138 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:34:48.140 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:35:03.210 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:35:03.212 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:35:18.286 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:35:18.288 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:35:33.386 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:35:33.388 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:35:48.479 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:35:48.481 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:36:03.567 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:36:03.569 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:36:18.662 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-11-08T17:36:18.665 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-08T17:36:18.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:18.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:21.791 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-08T17:36:21.822 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-08T17:36:27.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:27.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:30.874 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-08T17:36:30.875 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-08T17:36:36.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:36.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:39.930 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-08T17:36:39.931 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-08T17:36:45.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:45.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:48.986 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-08T17:36:49.022 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-08T17:36:54.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:55.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:36:58.042 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-08T17:36:58.142 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-08T17:37:04.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:37:04.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:37:07.098 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-11-08T17:37:13.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:38:04.198 WARNING:teuthology.provision.fog.smithi192:timed out 2023-11-08T17:38:10.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:38:10.546 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T17:38:10.547 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T17:38:10.859 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-11-08T17:38:10.860 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-11-08T17:38:10.875 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-11-08T17:38:10.875 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-11-08T17:38:10.931 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-11-08T17:38:10.932 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-11-08T17:38:11.036 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-11-08T17:38:11.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-11-08T17:38:11.132 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-11-08T17:38:11.200 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-11-08T17:38:11.265 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-08T17:38:11.319 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-11-08T17:38:11.320 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-11-08T17:38:11.320 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-11-08T17:38:11.320 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-11-08T17:38:11.320 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-11-08T17:38:11.320 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-11-08T17:38:11.321 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T17:38:11.321 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-11-08T17:38:11.321 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-11-08T17:38:11.321 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T17:38:11.321 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-11-08T17:38:11.322 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T17:38:11.322 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T17:38:11.322 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T17:38:11.323 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-11-08T17:38:11.324 DEBUG:teuthology.parallel:result is None 2023-11-08T17:38:13.107 WARNING:teuthology.provision.fog.smithi155:timed out 2023-11-08T17:38:19.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:38:19.331 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T17:38:19.332 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T17:38:19.676 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-11-08T17:38:19.677 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-11-08T17:38:19.691 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-11-08T17:38:19.691 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-11-08T17:38:19.746 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-11-08T17:38:19.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-11-08T17:38:19.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-11-08T17:38:19.868 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-11-08T17:38:19.935 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-11-08T17:38:20.002 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-11-08T17:38:20.068 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-11-08T17:38:20.122 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-11-08T17:38:20.122 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-11-08T17:38:20.122 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-11-08T17:38:20.123 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-11-08T17:38:20.123 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-11-08T17:38:20.124 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-11-08T17:38:20.124 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T17:38:20.124 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-11-08T17:38:20.125 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-11-08T17:38:20.125 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T17:38:20.125 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-11-08T17:38:20.126 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T17:38:20.126 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T17:38:20.126 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T17:38:20.127 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-11-08T17:38:20.128 DEBUG:teuthology.parallel:result is None 2023-11-08T17:38:20.291 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-11-08T17:38:20.292 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T17:38:20.330 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-11-08T17:38:20.330 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T17:38:20.356 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-11-08T17:38:20.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-11-08T17:38:20.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:38:20.440 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-11-08T17:38:20.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-11-08T17:38:20.505 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-11-08T17:38:20.558 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-11-08T17:38:20.558 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-11-08T17:38:20.612 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-11-08T17:38:20.612 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-11-08T17:38:20.613 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-11-08T17:38:20.613 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-11-08T17:38:20.613 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-11-08T17:38:20.613 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-11-08T17:38:20.613 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T17:38:20.614 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-11-08T17:38:20.614 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-11-08T17:38:20.614 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T17:38:20.614 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-11-08T17:38:20.614 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T17:38:20.614 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T17:38:20.615 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T17:38:20.615 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-11-08T17:38:20.630 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-11-08T17:38:20.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-08T17:38:20.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T17:38:20.711 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-11-08T17:38:20.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-08T17:38:20.782 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-11-08T17:38:20.837 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-11-08T17:38:20.838 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-08T17:38:20.894 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-11-08T17:38:20.894 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-11-08T17:38:20.895 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-11-08T17:38:20.895 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-11-08T17:38:20.895 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-11-08T17:38:20.895 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-11-08T17:38:20.896 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T17:38:20.896 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-11-08T17:38:20.896 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-11-08T17:38:20.896 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T17:38:20.896 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-11-08T17:38:20.897 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T17:38:20.897 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T17:38:20.897 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T17:38:20.897 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-08T17:38:20.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:38:21.056 INFO:teuthology.dispatcher.supervisor:Running job 7452098 2023-11-08T17:38:21.057 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-11-08_17:29:21-rgw-reef-release-distro-default-smithi/7452098 --name cbodley-2023-11-08_17:29:21-rgw-reef-release-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-11-08_17:29:21-rgw-reef-release-distro-default-smithi/7452098/orig.config.yaml 2023-11-08T17:38:21.059 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-11-08_17:29:21-rgw-reef-release-distro-default-smithi/7452098 2023-11-08T17:38:21.060 INFO:teuthology.dispatcher.supervisor:Job PID: 2620064 2023-11-08T17:38:21.060 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-08T17:40:21.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:42:21.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:44:21.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:46:21.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:48:21.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:50:22.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:52:22.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:54:22.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:56:22.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T17:58:22.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:00:22.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:02:23.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:04:23.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:06:23.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:08:23.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:10:23.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:12:23.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:14:24.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:16:24.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:18:24.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:20:24.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:22:24.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:24:24.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:26:25.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:28:25.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:30:25.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:32:25.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:34:25.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T18:34:25.751 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-08T18:34:25.947 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-08T18:34:25.948 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T18:34:25.999 DEBUG:teuthology.nuke:shortname: smithi155 2023-11-08T18:34:26.000 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T18:34:26.024 DEBUG:teuthology.nuke:shortname: smithi192 2023-11-08T18:34:26.024 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T18:34:26.027 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-11-08_17:29:21-rgw-reef-release-distro-default-smithi/7452098', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 17:33:14.380258', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAsF8zMoOhlNsR1eq+qD8T8/yRRWiym9dyEjstdTXrQWNqwka8G+WYUNCpGF39wO+BXQJ+17k7DbEEuUxIKawp4='} 2023-11-08T18:34:26.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-11-08_17:29:21-rgw-reef-release-distro-default-smithi/7452098', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 17:33:14.381870', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDplQGZfBwsnuU8wa5ZrmZaMGM21hlhJy6NA2dfOSbkafhGf61L+2Cz9/raL7AeGYEx9KC2iADzTbZiY66lmSyQ='} 2023-11-08T18:34:26.078 INFO:teuthology.orchestra.console.smithi155:Power off 2023-11-08T18:34:26.079 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T18:34:26.105 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-11-08T18:34:26.105 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T18:34:26.119 INFO:teuthology.orchestra.console.smithi192:Power off 2023-11-08T18:34:26.119 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T18:34:26.128 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-11-08T18:34:26.140 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-11-08T18:34:26.140 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T18:34:26.159 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-08T18:34:26.229 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-11-08T18:34:26.261 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-11-08T18:34:26.383 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2023-11-08T18:34:26.408 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com