2023-10-03T03:34:54.989 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T03:34:54.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T03:34:55.130 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f026fe75670>, signals=[15]) 2023-10-03T03:34:55.131 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-10-03T03:34:55.131 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T03:34:55.131 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-03T03:34:55.177 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-10-03T03:34:55.177 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T03:34:55.177 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-03T03:34:55.179 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-10-03T03:34:55.218 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-10-03T03:34:55.289 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-03T03:34:55.295 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-03T03:34:55.337 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-03T03:34:55.337 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 5} 2023-10-03T03:34:55.340 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-03T03:34:55.340 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 5} 2023-10-03T03:34:55.382 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6 2023-10-03T03:34:55.382 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:34:55.385 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6 2023-10-03T03:34:55.386 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:34:55.471 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T03:34:55.475 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T03:34:55.507 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-10-03T03:34:55.514 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-10-03T03:34:55.568 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:34:55.571 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:34:55.696 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-03T03:34:55.696 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T03:34:55.709 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-03T03:34:55.709 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T03:34:55.716 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-03T03:34:55.717 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T03:34:55.731 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-03T03:34:55.732 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T03:34:55.740 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-03T03:34:55.752 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-03T03:34:55.842 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-03T03:34:55.853 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-03T03:34:55.943 INFO:teuthology.orchestra.console.smithi031:Power on 2023-10-03T03:34:55.943 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T03:34:55.954 INFO:teuthology.orchestra.console.smithi114:Power on 2023-10-03T03:34:55.955 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T03:34:55.966 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-10-03T03:34:55.966 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T03:34:55.977 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2023-10-03T03:34:55.977 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T03:34:55.989 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-03T03:34:55.998 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-03T03:34:59.994 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T03:35:00.001 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T03:35:00.103 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-03T03:35:00.109 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-03T03:35:00.209 INFO:teuthology.orchestra.console.smithi114:Power on completed 2023-10-03T03:35:00.310 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-10-03T03:35:00.310 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:35:04.106 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T03:35:04.216 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-03T03:35:04.317 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-10-03T03:35:04.417 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-10-03T03:35:04.417 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:35:15.402 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:35:19.518 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:35:30.514 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:35:34.614 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:35:45.614 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:35:49.700 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:36:00.721 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:36:04.807 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:36:15.802 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:36:19.886 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:36:30.882 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:36:34.954 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:36:45.958 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:36:50.024 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:37:01.041 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:37:05.104 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:37:16.149 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:37:20.190 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:37:31.234 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:37:35.282 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-03T03:37:35.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:37:38.426 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-03T03:37:44.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:37:46.314 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-03T03:37:46.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:37:47.482 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-03T03:37:49.438 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-03T03:37:53.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:37:55.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:37:56.538 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-03T03:37:58.522 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-03T03:38:02.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:38:04.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:38:05.598 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-03T03:38:07.582 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-03T03:38:11.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:38:13.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:38:16.666 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-03T03:38:22.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:38:25.722 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-03T03:38:31.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:38:34.778 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-03T03:38:40.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:38:43.834 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-03T03:38:49.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:39:11.626 WARNING:teuthology.provision.fog.smithi031:timed out 2023-10-03T03:39:17.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:39:18.170 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T03:39:18.171 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T03:39:18.685 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-10-03T03:39:18.685 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-10-03T03:39:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-10-03T03:39:18.706 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-10-03T03:39:18.765 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-10-03T03:39:18.766 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-03T03:39:18.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-10-03T03:39:18.928 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-10-03T03:39:18.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-10-03T03:39:19.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-03T03:39:19.136 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-03T03:39:19.194 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-10-03T03:39:19.194 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T03:39:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-03T03:39:19.196 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T03:39:19.196 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-03T03:39:19.196 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-03T03:39:19.196 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-03T03:39:19.196 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-10-03T03:39:19.197 DEBUG:teuthology.parallel:result is None 2023-10-03T03:39:49.870 WARNING:teuthology.provision.fog.smithi114:timed out 2023-10-03T03:39:55.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:39:56.196 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T03:39:56.197 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T03:39:56.470 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-10-03T03:39:56.470 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-10-03T03:39:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114 2023-10-03T03:39:56.488 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114 /etc/hosts 2023-10-03T03:39:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-10-03T03:39:56.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-03T03:39:56.665 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114/smithi114/g' /etc/hosts 2023-10-03T03:39:56.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2023-10-03T03:39:56.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114/smithi114/g' /etc/hostname 2023-10-03T03:39:56.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-03T03:39:56.892 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-03T03:39:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-10-03T03:39:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-10-03T03:39:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-10-03T03:39:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-10-03T03:39:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-10-03T03:39:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-03T03:39:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-03T03:39:56.951 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-10-03T03:39:56.951 DEBUG:teuthology.parallel:result is None 2023-10-03T03:39:57.129 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-10-03T03:39:57.129 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T03:39:57.154 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-10-03T03:39:57.154 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T03:39:57.180 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-10-03T03:39:57.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-03T03:39:57.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:39:57.248 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-03T03:39:57.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-03T03:39:57.385 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-10-03T03:39:57.444 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-10-03T03:39:57.444 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-03T03:39:57.503 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-10-03T03:39:57.503 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-10-03T03:39:57.503 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-10-03T03:39:57.503 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-10-03T03:39:57.503 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-10-03T03:39:57.503 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-03T03:39:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-03T03:39:57.505 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-03T03:39:57.537 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-10-03T03:39:57.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-03T03:39:57.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T03:39:57.604 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-10-03T03:39:57.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-03T03:39:57.672 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-10-03T03:39:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-10-03T03:39:57.730 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-03T03:39:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-10-03T03:39:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-10-03T03:39:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-10-03T03:39:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-10-03T03:39:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T03:39:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-03T03:39:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-03T03:39:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-03T03:39:57.790 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-03T03:39:57.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T03:39:57.919 INFO:teuthology.dispatcher.supervisor:Running job 7409351 2023-10-03T03:39:57.920 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-10-03_02:47:15-fs-wip-pdonnell-testing-20231002.183052-distro-default-smithi/7409351 --name pdonnell-2023-10-03_02:47:15-fs-wip-pdonnell-testing-20231002.183052-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/pdonnell-2023-10-03_02:47:15-fs-wip-pdonnell-testing-20231002.183052-distro-default-smithi/7409351/orig.config.yaml 2023-10-03T03:39:57.922 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-10-03_02:47:15-fs-wip-pdonnell-testing-20231002.183052-distro-default-smithi/7409351 2023-10-03T03:39:57.923 INFO:teuthology.dispatcher.supervisor:Job PID: 3805519 2023-10-03T03:39:57.923 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-03T03:41:58.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T03:43:58.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T03:43:58.190 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-10-03T03:43:58.290 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi114 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-10-03_02:47:15-fs-wip-pdonnell-testing-20231002.183052-distro-default-smithi/7409370