2023-07-26T15:34:41.876 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T15:34:41.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:34:41.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:34:42.031 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f931feb4280>, signals=[15]) 2023-07-26T15:34:42.034 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-07-26T15:34:42.034 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T15:34:42.035 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-07-26T15:34:42.056 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-07-26T15:34:42.057 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T15:34:42.057 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-07-26T15:34:42.060 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"} 2023-07-26T15:34:42.080 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"} 2023-07-26T15:34:42.138 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-26T15:34:42.165 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-26T15:34:42.180 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2023-07-26T15:34:42.181 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 10} 2023-07-26T15:34:42.205 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2023-07-26T15:34:42.206 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 10} 2023-07-26T15:34:42.222 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2023-07-26T15:34:42.223 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:34:42.251 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2023-07-26T15:34:42.251 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:34:42.262 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T15:34:42.289 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T15:34:42.298 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1} 2023-07-26T15:34:42.319 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1} 2023-07-26T15:34:42.348 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:34:42.376 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:34:42.431 INFO:teuthology.orchestra.console:Power off smithi084 2023-07-26T15:34:42.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T15:34:42.453 INFO:teuthology.orchestra.console:Power off smithi119 2023-07-26T15:34:42.454 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T15:34:42.461 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T15:34:42.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:42.473 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T15:34:42.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:42.482 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T15:34:42.494 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T15:34:46.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:46.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:46.593 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T15:34:46.605 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T15:34:50.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:50.606 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:50.707 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T15:34:50.717 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T15:34:50.818 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-07-26T15:34:50.918 INFO:teuthology.orchestra.console:Power on smithi119 2023-07-26T15:34:50.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T15:34:50.940 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T15:34:50.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:50.964 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T15:34:54.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:54.819 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T15:34:54.920 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2023-07-26T15:34:54.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:55.022 INFO:teuthology.orchestra.console:Power on smithi084 2023-07-26T15:34:55.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T15:34:55.042 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T15:34:55.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:55.061 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T15:34:55.075 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T15:34:59.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:59.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:34:59.175 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T15:34:59.195 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T15:34:59.296 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2023-07-26T15:34:59.397 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-07-26T15:34:59.398 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:35:03.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T15:35:03.290 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T15:35:03.391 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2023-07-26T15:35:03.492 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-07-26T15:35:03.493 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:35:14.459 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:35:18.556 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:35:29.524 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:35:33.608 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:35:44.584 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:35:48.660 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:35:59.644 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:36:03.716 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:36:14.705 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:36:18.771 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:36:29.763 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:36:33.824 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:36:44.818 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:36:48.879 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:36:59.880 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:37:03.925 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:37:14.936 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:37:18.980 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:37:30.008 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-26T15:37:30.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:37:34.033 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:37:48.400 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-26T15:37:49.084 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-07-26T15:37:49.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:37:54.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:37:57.456 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-26T15:38:03.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:38:06.516 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-26T15:38:07.600 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-26T15:38:12.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:38:13.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:38:15.604 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-26T15:38:16.656 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-26T15:38:21.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:38:22.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:38:24.688 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-26T15:38:25.712 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-26T15:38:30.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:38:31.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:38:34.772 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-26T15:38:40.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:39:30.740 WARNING:teuthology.provision.fog.smithi119:timed out 2023-07-26T15:39:36.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:39:36.932 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T15:39:36.932 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T15:39:37.274 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-07-26T15:39:37.275 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2023-07-26T15:39:37.289 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2023-07-26T15:39:37.289 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2023-07-26T15:39:37.345 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2023-07-26T15:39:37.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-07-26T15:39:37.461 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2023-07-26T15:39:37.491 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2023-07-26T15:39:37.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2023-07-26T15:39:37.628 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-07-26T15:39:37.695 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-07-26T15:39:37.750 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-07-26T15:39:37.750 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2023-07-26T15:39:37.750 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-07-26T15:39:37.750 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-07-26T15:39:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2023-07-26T15:39:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2023-07-26T15:39:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T15:39:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-07-26T15:39:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2023-07-26T15:39:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T15:39:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-07-26T15:39:37.752 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T15:39:37.752 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T15:39:37.752 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T15:39:37.752 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2023-07-26T15:39:37.754 DEBUG:teuthology.parallel:result is None 2023-07-26T15:39:40.781 WARNING:teuthology.provision.fog.smithi084:timed out 2023-07-26T15:39:46.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:39:47.017 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T15:39:47.017 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T15:39:47.343 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-07-26T15:39:47.343 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-07-26T15:39:47.358 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2023-07-26T15:39:47.359 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2023-07-26T15:39:47.415 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-07-26T15:39:47.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-07-26T15:39:47.530 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2023-07-26T15:39:47.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-07-26T15:39:47.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2023-07-26T15:39:47.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-07-26T15:39:47.760 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-07-26T15:39:47.813 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-07-26T15:39:47.814 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2023-07-26T15:39:47.814 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-07-26T15:39:47.814 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-07-26T15:39:47.814 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2023-07-26T15:39:47.814 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2023-07-26T15:39:47.814 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T15:39:47.815 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-07-26T15:39:47.815 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2023-07-26T15:39:47.815 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T15:39:47.815 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-07-26T15:39:47.815 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T15:39:47.815 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T15:39:47.815 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T15:39:47.816 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-07-26T15:39:47.816 DEBUG:teuthology.parallel:result is None 2023-07-26T15:39:47.974 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-07-26T15:39:47.974 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T15:39:48.029 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2023-07-26T15:39:48.030 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T15:39:48.056 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-07-26T15:39:48.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-26T15:39:48.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:39:48.139 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-07-26T15:39:48.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-26T15:39:48.202 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-07-26T15:39:48.255 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-07-26T15:39:48.256 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-07-26T15:39:48.309 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-07-26T15:39:48.309 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2023-07-26T15:39:48.310 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-07-26T15:39:48.310 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-07-26T15:39:48.310 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2023-07-26T15:39:48.310 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2023-07-26T15:39:48.310 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T15:39:48.310 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-07-26T15:39:48.310 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2023-07-26T15:39:48.311 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T15:39:48.311 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-07-26T15:39:48.311 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T15:39:48.311 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T15:39:48.311 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T15:39:48.312 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-07-26T15:39:48.337 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2023-07-26T15:39:48.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-26T15:39:48.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T15:39:48.421 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-07-26T15:39:48.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-26T15:39:48.542 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-07-26T15:39:48.596 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-07-26T15:39:48.596 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-07-26T15:39:48.650 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-07-26T15:39:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2023-07-26T15:39:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-07-26T15:39:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-07-26T15:39:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2023-07-26T15:39:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2023-07-26T15:39:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T15:39:48.651 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-07-26T15:39:48.652 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2023-07-26T15:39:48.652 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T15:39:48.652 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-07-26T15:39:48.652 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T15:39:48.653 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T15:39:48.653 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T15:39:48.653 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-07-26T15:39:48.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:39:48.679 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:39:48.788 INFO:teuthology.dispatcher.supervisor:Running job 7351862 2023-07-26T15:39:48.788 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-25_15:15:44-rgw-reef-release-distro-default-smithi/7351862 --name yuriw-2023-07-25_15:15:44-rgw-reef-release-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{cls ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-07-25_15:15:44-rgw-reef-release-distro-default-smithi/7351862/orig.config.yaml 2023-07-26T15:39:48.792 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-25_15:15:44-rgw-reef-release-distro-default-smithi/7351862 2023-07-26T15:39:48.793 INFO:teuthology.dispatcher.supervisor:Job PID: 20995 2023-07-26T15:39:48.793 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T15:41:48.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:41:48.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:43:49.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:43:49.073 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:45:49.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:45:49.172 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:47:49.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:47:49.329 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:49:49.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:49:49.506 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:51:49.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:51:49.681 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:53:49.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:53:49.849 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:55:50.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:55:50.018 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:57:50.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:57:50.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T15:59:50.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T15:59:50.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:01:50.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:01:50.556 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:03:50.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:03:50.730 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:05:50.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:05:50.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:07:51.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:07:51.078 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:09:51.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:09:51.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:11:51.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:11:51.577 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:13:51.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:13:51.753 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:15:51.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:15:51.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:17:52.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:17:52.097 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:19:52.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:19:52.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:21:52.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:21:52.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:23:52.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:23:52.621 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:25:52.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:25:52.801 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:27:52.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:27:52.974 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:29:53.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:29:53.143 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:31:53.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:31:53.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:33:53.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:33:53.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:35:53.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:35:53.653 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:37:53.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T16:37:53.834 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T16:37:53.907 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T16:37:54.026 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T16:37:54.026 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T16:37:54.077 DEBUG:teuthology.nuke:shortname: smithi084 2023-07-26T16:37:54.078 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T16:37:54.101 DEBUG:teuthology.nuke:shortname: smithi119 2023-07-26T16:37:54.102 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T16:37:54.104 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_15:15:44-rgw-reef-release-distro-default-smithi/7351862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 15:34:41.039398', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGTJsaSJ9IqjHS3zWkBnkwApsFabgdpgTMpWK9yHZy+hWqQ97aOtEW6HVBaZJdv9SrYcn9WKWm4ULaU40SIKWMk='} 2023-07-26T16:37:54.129 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_15:15:44-rgw-reef-release-distro-default-smithi/7351862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 15:34:41.037283', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHHSQj3L92MflxpnebHf//DL8UHON0JtGe3nhs64nlAZAUTs45MWfz6+By1g3fmZEim2MmSsCV4qU6to7f6Vgk='} 2023-07-26T16:37:54.164 INFO:teuthology.orchestra.console:Power off smithi084 2023-07-26T16:37:54.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T16:37:54.183 INFO:teuthology.orchestra.console:Power off smithi119 2023-07-26T16:37:54.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T16:37:54.196 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T16:37:54.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T16:37:54.208 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T16:37:54.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T16:37:54.219 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T16:37:54.229 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T16:37:54.321 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2023-07-26T16:37:54.331 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-07-26T16:37:54.484 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2023-07-26T16:37:54.489 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com