2023-11-03T12:09:52.456 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-03T12:09:52.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:09:52.612 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f450372f670>, signals=[15]) 2023-11-03T12:09:52.614 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-11-03T12:09:52.614 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T12:09:52.614 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-11-03T12:09:52.630 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-11-03T12:09:52.630 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T12:09:52.631 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-11-03T12:09:52.632 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-11-03T12:09:52.655 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"} 2023-11-03T12:09:52.713 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-03T12:09:52.723 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-03T12:09:52.754 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-03T12:09:52.755 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 5} 2023-11-03T12:09:52.765 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-03T12:09:52.766 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 5} 2023-11-03T12:09:52.800 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.6 2023-11-03T12:09:52.800 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:09:52.812 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6 2023-11-03T12:09:52.812 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:09:52.877 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T12:09:52.882 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T12:09:52.919 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-11-03T12:09:52.922 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1} 2023-11-03T12:09:52.989 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:09:52.993 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:09:53.124 INFO:teuthology.orchestra.console.smithi003:Power off 2023-11-03T12:09:53.125 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T12:09:53.140 INFO:teuthology.orchestra.console.smithi119:Power off 2023-11-03T12:09:53.141 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T12:09:53.149 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-11-03T12:09:53.150 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:09:53.166 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-11-03T12:09:53.167 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:09:53.177 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-11-03T12:09:53.189 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-03T12:09:57.182 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:09:57.190 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:09:57.292 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-11-03T12:09:57.299 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-03T12:10:01.294 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:01.301 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:01.402 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-11-03T12:10:01.411 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-03T12:10:05.409 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:05.416 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:05.518 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-11-03T12:10:05.525 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-03T12:10:05.620 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-11-03T12:10:05.627 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-11-03T12:10:05.722 INFO:teuthology.orchestra.console.smithi003:Power on 2023-11-03T12:10:05.722 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T12:10:05.729 INFO:teuthology.orchestra.console.smithi119:Power on 2023-11-03T12:10:05.731 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T12:10:05.747 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-11-03T12:10:05.748 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:05.757 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2023-11-03T12:10:05.757 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:05.774 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-11-03T12:10:05.779 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-03T12:10:09.778 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:09.785 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:09.888 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-11-03T12:10:09.894 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-03T12:10:09.990 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-11-03T12:10:10.091 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-11-03T12:10:10.091 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:10:13.898 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:10:14.010 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-03T12:10:14.111 INFO:teuthology.orchestra.console.smithi119:Power on completed 2023-11-03T12:10:14.215 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-11-03T12:10:14.216 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:10:25.194 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:10:29.288 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:10:40.282 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:10:44.370 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:10:55.370 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:10:59.444 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:11:10.452 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:11:14.530 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:11:25.542 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:11:29.621 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:11:40.630 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:11:44.694 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:11:55.710 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:11:59.762 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:12:10.802 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:12:14.838 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:12:25.886 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:12:29.910 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:12:40.974 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:12:44.986 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-03T12:12:45.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:12:45.369 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-03T12:12:56.118 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-11-03T12:12:56.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:12:59.258 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-11-03T12:13:05.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:13:08.320 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-11-03T12:13:14.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:13:17.406 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-11-03T12:13:23.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:13:26.458 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-11-03T12:13:32.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:13:35.518 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-11-03T12:13:41.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:13:49.374 WARNING:teuthology.provision.fog.smithi119:timed out 2023-11-03T12:13:55.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:14:13.886 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-03T12:14:19.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:14:22.784 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T12:14:22.785 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T12:14:23.041 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-11-03T12:14:23.042 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2023-11-03T12:14:23.057 INFO:teuthology.orchestra.run.smithi119.stdout:smithi022 2023-11-03T12:14:23.058 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi022 /etc/hosts 2023-11-03T12:14:23.114 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-11-03T12:14:23.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-11-03T12:14:23.239 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi022/smithi119/g' /etc/hosts 2023-11-03T12:14:23.267 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.22/172.21.15.119/g' /etc/hosts 2023-11-03T12:14:23.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi022/smithi119/g' /etc/hostname 2023-11-03T12:14:23.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-11-03T12:14:23.466 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-11-03T12:14:23.523 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-11-03T12:14:23.523 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-11-03T12:14:23.523 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-11-03T12:14:23.524 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-11-03T12:14:23.524 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-11-03T12:14:23.524 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-11-03T12:14:23.524 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-03T12:14:23.524 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-11-03T12:14:23.525 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-03T12:14:23.525 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-11-03T12:14:23.525 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-03T12:14:23.525 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:14:23.525 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-03T12:14:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-03T12:14:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-03T12:14:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-03T12:14:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-03T12:14:23.527 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2023-11-03T12:14:23.528 DEBUG:teuthology.parallel:result is None 2023-11-03T12:14:41.522 WARNING:teuthology.provision.fog.smithi003:timed out 2023-11-03T12:14:47.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:14:47.863 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T12:14:47.863 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T12:14:48.309 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-11-03T12:14:48.310 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-11-03T12:14:48.331 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-11-03T12:14:48.331 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-11-03T12:14:48.391 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-11-03T12:14:48.392 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-11-03T12:14:48.516 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-11-03T12:14:48.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-11-03T12:14:48.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-11-03T12:14:48.685 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-11-03T12:14:48.753 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-11-03T12:14:48.811 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-11-03T12:14:48.811 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-11-03T12:14:48.811 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-11-03T12:14:48.812 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-11-03T12:14:48.812 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-11-03T12:14:48.812 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-11-03T12:14:48.812 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-03T12:14:48.812 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-11-03T12:14:48.812 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-03T12:14:48.813 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-11-03T12:14:48.813 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-03T12:14:48.813 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:14:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-11-03T12:14:48.813 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-03T12:14:48.814 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-03T12:14:48.814 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-03T12:14:48.814 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-03T12:14:48.814 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-11-03T12:14:48.815 DEBUG:teuthology.parallel:result is None 2023-11-03T12:14:48.975 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-11-03T12:14:48.976 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T12:14:49.000 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2023-11-03T12:14:49.001 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T12:14:49.018 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-11-03T12:14:49.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-11-03T12:14:49.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:14:49.086 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-11-03T12:14:49.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-11-03T12:14:49.152 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-11-03T12:14:49.209 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-11-03T12:14:49.210 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-11-03T12:14:49.266 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-11-03T12:14:49.266 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-11-03T12:14:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-11-03T12:14:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-11-03T12:14:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-11-03T12:14:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-11-03T12:14:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-03T12:14:49.268 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-11-03T12:14:49.268 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-03T12:14:49.268 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-11-03T12:14:49.268 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-03T12:14:49.268 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:14:49.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-11-03T12:14:49.269 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-03T12:14:49.269 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-03T12:14:49.269 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-03T12:14:49.269 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-03T12:14:49.270 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-11-03T12:14:49.292 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2023-11-03T12:14:49.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-03T12:14:49.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:14:49.361 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-11-03T12:14:49.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-03T12:14:49.437 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-11-03T12:14:49.496 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-11-03T12:14:49.497 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-11-03T12:14:49.556 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-11-03T12:14:49.556 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-11-03T12:14:49.556 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-11-03T12:14:49.556 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-11-03T12:14:49.557 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-11-03T12:14:49.557 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-11-03T12:14:49.557 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-03T12:14:49.557 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-11-03T12:14:49.557 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-03T12:14:49.558 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-11-03T12:14:49.558 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-03T12:14:49.558 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:14:49.558 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-03T12:14:49.558 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-03T12:14:49.559 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-03T12:14:49.559 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-03T12:14:49.559 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-03T12:14:49.560 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-11-03T12:14:49.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:14:49.657 INFO:teuthology.dispatcher.supervisor:Running job 7445503 2023-11-03T12:14:49.657 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445503 --name rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445503/orig.config.yaml 2023-11-03T12:14:49.660 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445503 2023-11-03T12:14:49.661 INFO:teuthology.dispatcher.supervisor:Job PID: 2286397 2023-11-03T12:14:49.661 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-03T12:16:49.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:18:49.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:20:49.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:22:49.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:24:49.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:26:50.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:28:50.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:30:50.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:32:50.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:34:50.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:36:50.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:38:50.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:40:50.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:42:50.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:44:50.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:46:50.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:48:50.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:50:50.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:52:50.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:54:51.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:56:51.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:58:51.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:00:51.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:02:51.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:04:51.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:06:51.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:08:51.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:10:51.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:12:51.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:14:51.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:16:51.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:18:51.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:20:51.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:22:51.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:24:52.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:26:52.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:28:52.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:30:52.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:32:52.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:34:52.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:36:52.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:38:52.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:40:52.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:42:52.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T13:42:52.758 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-03T13:42:52.926 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-03T13:42:52.926 INFO:teuthology.nuke:Checking targets against current locks 2023-11-03T13:42:52.980 DEBUG:teuthology.nuke:shortname: smithi003 2023-11-03T13:42:52.981 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T13:42:53.002 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 12:09:51.655257', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-03T13:42:53.008 DEBUG:teuthology.nuke:shortname: smithi119 2023-11-03T13:42:53.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T13:42:53.033 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 12:09:51.657271', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-03T13:42:53.070 INFO:teuthology.orchestra.console.smithi003:Power off 2023-11-03T13:42:53.071 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T13:42:53.100 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-11-03T13:42:53.100 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T13:42:53.124 INFO:teuthology.orchestra.console.smithi119:Power off 2023-11-03T13:42:53.125 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T13:42:53.138 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-11-03T13:42:53.151 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-11-03T13:42:53.152 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T13:42:53.179 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-03T13:42:53.240 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-11-03T13:42:53.281 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-11-03T13:42:53.391 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-11-03T13:42:53.431 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com