2023-10-16T08:33:28.679 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T08:33:28.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:33:28.825 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fedcc722c10>, signals=[15]) 2023-10-16T08:33:28.826 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-10-16T08:33:28.826 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T08:33:28.827 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-16T08:33:28.857 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-10-16T08:33:28.857 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T08:33:28.858 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-16T08:33:28.859 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-10-16T08:33:28.882 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-10-16T08:33:28.934 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T08:33:28.958 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T08:33:28.973 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T08:33:28.974 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 5} 2023-10-16T08:33:29.003 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T08:33:29.003 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 5} 2023-10-16T08:33:29.014 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6 2023-10-16T08:33:29.014 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:33:29.054 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T08:33:29.057 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.6 2023-10-16T08:33:29.058 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:33:29.100 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-10-16T08:33:29.103 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T08:33:29.139 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-10-16T08:33:29.198 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:33:29.212 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:33:29.287 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-16T08:33:29.288 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T08:33:29.300 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-16T08:33:29.301 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T08:33:29.309 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-16T08:33:29.310 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:33:29.323 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-16T08:33:29.324 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:33:29.333 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-16T08:33:29.346 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-16T08:33:29.434 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-16T08:33:29.447 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-16T08:33:29.536 INFO:teuthology.orchestra.console.smithi192:Power on 2023-10-16T08:33:29.536 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T08:33:29.548 INFO:teuthology.orchestra.console.smithi124:Power on 2023-10-16T08:33:29.549 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T08:33:29.557 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-10-16T08:33:29.558 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:33:29.570 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-10-16T08:33:29.570 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:33:29.579 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-16T08:33:29.596 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-16T08:33:33.582 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:33:33.597 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:33:33.693 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-16T08:33:33.705 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-16T08:33:33.795 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-10-16T08:33:33.806 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-10-16T08:33:33.897 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-10-16T08:33:33.897 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:33:33.908 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-10-16T08:33:33.908 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:33:48.964 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:33:48.967 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:34:04.050 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:34:04.052 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:34:19.138 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:34:19.140 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:34:34.206 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:34:34.208 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:34:49.278 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:34:49.286 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:35:04.358 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:35:04.360 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:35:19.434 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:35:19.436 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:35:34.515 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:35:34.517 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:35:49.595 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:35:49.597 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:36:04.678 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:36:04.680 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:36:19.750 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-16T08:36:19.753 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-16T08:36:19.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:19.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:38.138 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T08:36:38.139 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-16T08:36:44.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:44.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:47.194 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T08:36:47.195 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-16T08:36:53.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:53.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:56.250 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T08:36:56.286 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-16T08:37:02.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:37:02.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:37:05.310 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T08:37:05.338 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-16T08:37:11.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:37:11.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:37:14.394 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-16T08:37:20.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:38:11.371 WARNING:teuthology.provision.fog.smithi124:timed out 2023-10-16T08:38:17.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:38:17.707 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T08:38:17.708 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T08:38:18.016 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-10-16T08:38:18.017 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-10-16T08:38:18.035 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-10-16T08:38:18.036 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-10-16T08:38:18.096 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-10-16T08:38:18.096 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-16T08:38:18.230 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-10-16T08:38:18.263 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-10-16T08:38:18.335 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-10-16T08:38:18.404 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-16T08:38:18.472 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-16T08:38:18.529 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T08:38:18.530 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T08:38:18.530 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-10-16T08:38:18.530 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-10-16T08:38:18.530 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-10-16T08:38:18.530 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-16T08:38:18.531 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T08:38:18.531 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-16T08:38:18.531 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T08:38:18.532 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T08:38:18.532 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T08:38:18.532 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:38:18.532 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T08:38:18.533 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T08:38:18.533 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T08:38:18.533 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T08:38:18.533 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T08:38:18.534 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-10-16T08:38:18.536 DEBUG:teuthology.parallel:result is None 2023-10-16T08:38:20.402 WARNING:teuthology.provision.fog.smithi192:timed out 2023-10-16T08:38:26.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:38:26.637 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T08:38:26.638 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T08:38:26.893 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-10-16T08:38:26.893 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-10-16T08:38:26.912 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192 2023-10-16T08:38:26.912 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192 /etc/hosts 2023-10-16T08:38:26.971 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-10-16T08:38:26.977 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-16T08:38:27.086 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192/smithi192/g' /etc/hosts 2023-10-16T08:38:27.116 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-10-16T08:38:27.182 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192/smithi192/g' /etc/hostname 2023-10-16T08:38:27.249 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-16T08:38:27.314 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-16T08:38:27.370 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T08:38:27.371 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T08:38:27.371 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2023-10-16T08:38:27.371 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2023-10-16T08:38:27.371 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2023-10-16T08:38:27.371 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-10-16T08:38:27.372 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T08:38:27.372 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-16T08:38:27.372 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T08:38:27.372 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T08:38:27.372 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T08:38:27.373 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:38:27.373 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T08:38:27.373 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T08:38:27.373 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T08:38:27.373 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T08:38:27.374 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T08:38:27.374 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-10-16T08:38:27.375 DEBUG:teuthology.parallel:result is None 2023-10-16T08:38:27.525 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-10-16T08:38:27.526 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T08:38:27.555 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-10-16T08:38:27.555 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T08:38:27.581 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-10-16T08:38:27.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T08:38:27.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:38:27.649 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-16T08:38:27.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T08:38:27.718 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-16T08:38:27.775 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-16T08:38:27.776 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-16T08:38:27.833 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T08:38:27.833 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T08:38:27.833 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-10-16T08:38:27.834 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-10-16T08:38:27.834 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-10-16T08:38:27.834 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-16T08:38:27.834 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T08:38:27.835 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-16T08:38:27.835 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T08:38:27.835 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T08:38:27.835 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T08:38:27.835 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:38:27.836 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T08:38:27.836 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T08:38:27.836 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T08:38:27.836 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T08:38:27.837 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T08:38:27.837 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-16T08:38:27.855 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-10-16T08:38:27.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T08:38:27.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:38:27.919 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-16T08:38:27.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T08:38:27.991 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-10-16T08:38:28.047 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-10-16T08:38:28.048 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-16T08:38:28.105 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T08:38:28.105 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T08:38:28.105 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2023-10-16T08:38:28.106 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2023-10-16T08:38:28.106 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2023-10-16T08:38:28.106 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-10-16T08:38:28.106 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T08:38:28.106 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-16T08:38:28.107 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T08:38:28.107 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T08:38:28.107 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T08:38:28.107 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:38:28.107 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T08:38:28.108 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T08:38:28.108 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T08:38:28.108 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T08:38:28.108 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T08:38:28.109 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-16T08:38:28.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:38:28.222 INFO:teuthology.dispatcher.supervisor:Running job 7428937 2023-10-16T08:38:28.223 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428937 --name rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} -- /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428937/orig.config.yaml 2023-10-16T08:38:28.226 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428937 2023-10-16T08:38:28.227 INFO:teuthology.dispatcher.supervisor:Job PID: 575878 2023-10-16T08:38:28.227 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T08:40:28.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:42:28.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:44:28.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:46:28.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:48:28.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:50:29.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:52:29.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:54:29.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:56:29.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:56:29.738 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T08:56:29.846 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T08:56:29.847 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T08:56:29.898 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-16T08:56:29.898 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T08:56:29.921 DEBUG:teuthology.nuke:shortname: smithi192 2023-10-16T08:56:29.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T08:56:29.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 08:33:27.827709', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T08:56:29.946 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 08:33:27.829467', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T08:56:29.979 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-16T08:56:29.979 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T08:56:29.994 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-16T08:56:29.995 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T08:56:30.003 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-16T08:56:30.004 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:56:30.015 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-16T08:56:30.016 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:56:30.025 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-16T08:56:30.040 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-16T08:56:30.127 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-16T08:56:30.141 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-16T08:56:30.287 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2023-10-16T08:56:30.295 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com