2023-08-31T05:45:52.847 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T05:45:52.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T05:45:52.993 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa758d1d670>, signals=[15]) 2023-08-31T05:45:52.995 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-08-31T05:45:52.995 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T05:45:52.995 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-08-31T05:45:53.015 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2023-08-31T05:45:53.015 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T05:45:53.015 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-08-31T05:45:53.017 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-08-31T05:45:53.039 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"} 2023-08-31T05:45:53.138 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-31T05:45:53.142 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-31T05:45:53.182 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-31T05:45:53.182 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 5} 2023-08-31T05:45:53.185 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-31T05:45:53.186 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 5} 2023-08-31T05:45:53.228 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.6 2023-08-31T05:45:53.228 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:45:53.229 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.6 2023-08-31T05:45:53.229 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:45:53.280 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T05:45:53.284 DEBUG:teuthology.provision.fog.smithi136:Canceling deploy task with ID 472184 2023-08-31T05:45:53.284 DEBUG:teuthology.provision.fog.smithi136:FOG request: DELETE /task/cancel {"id": 472184} 2023-08-31T05:45:53.317 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-08-31T05:45:53.343 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T05:45:53.374 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1} 2023-08-31T05:45:53.384 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:45:53.424 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:45:53.460 INFO:teuthology.orchestra.console.smithi060:Power off 2023-08-31T05:45:53.461 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T05:45:53.485 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-08-31T05:45:53.486 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:45:53.507 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-08-31T05:45:53.514 INFO:teuthology.orchestra.console.smithi136:Power off 2023-08-31T05:45:53.514 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T05:45:53.533 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-08-31T05:45:53.533 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:45:53.556 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-31T05:45:57.511 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:45:57.557 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:45:57.620 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-08-31T05:45:57.666 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-31T05:46:01.624 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:46:01.668 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:46:01.735 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-08-31T05:46:01.777 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-31T05:46:01.836 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-08-31T05:46:01.878 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-08-31T05:46:01.937 INFO:teuthology.orchestra.console.smithi060:Power on 2023-08-31T05:46:01.937 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T05:46:01.958 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On 2023-08-31T05:46:01.959 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:46:01.979 INFO:teuthology.orchestra.console.smithi136:Power on 2023-08-31T05:46:01.980 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T05:46:01.985 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-08-31T05:46:01.999 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2023-08-31T05:46:02.000 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:46:02.020 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-31T05:46:05.990 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:46:06.022 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:46:06.098 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-08-31T05:46:06.131 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-31T05:46:06.199 INFO:teuthology.orchestra.console.smithi060:Power on completed 2023-08-31T05:46:06.300 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-08-31T05:46:06.301 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:46:10.134 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:46:10.243 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-31T05:46:10.344 INFO:teuthology.orchestra.console.smithi136:Power on completed 2023-08-31T05:46:10.445 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2023-08-31T05:46:10.446 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:46:21.374 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:46:25.508 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:46:36.446 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:46:40.582 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:46:51.522 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:46:55.642 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:47:06.598 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:47:10.706 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:47:21.674 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:47:25.770 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:47:36.750 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:47:40.834 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:47:51.822 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:47:55.905 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:48:06.902 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:48:10.979 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:48:21.978 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:48:26.054 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:48:37.047 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-08-31T05:48:37.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:48:40.190 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-08-31T05:48:41.124 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:48:46.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:48:49.281 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-08-31T05:48:55.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:48:56.185 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-31T05:48:56.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:48:58.366 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-08-31T05:49:04.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:49:07.450 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-08-31T05:49:13.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:49:16.506 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-08-31T05:49:22.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:49:25.566 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-08-31T05:49:30.906 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-31T05:49:31.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:49:36.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:49:39.962 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-31T05:49:45.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:49:49.022 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-31T05:49:55.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:50:03.520 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T05:50:03.521 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T05:50:03.867 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-08-31T05:50:03.867 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-08-31T05:50:03.884 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2023-08-31T05:50:03.885 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2023-08-31T05:50:03.942 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-08-31T05:50:03.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-08-31T05:50:04.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2023-08-31T05:50:04.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-08-31T05:50:04.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2023-08-31T05:50:04.247 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-08-31T05:50:04.314 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-08-31T05:50:04.372 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T05:50:04.372 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T05:50:04.372 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-08-31T05:50:04.373 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-08-31T05:50:04.373 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-08-31T05:50:04.373 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-08-31T05:50:04.373 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T05:50:04.374 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-08-31T05:50:04.374 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T05:50:04.374 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T05:50:04.374 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T05:50:04.375 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T05:50:04.375 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-08-31T05:50:04.375 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T05:50:04.376 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T05:50:04.376 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T05:50:04.376 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T05:50:04.377 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-08-31T05:50:04.378 DEBUG:teuthology.parallel:result is None 2023-08-31T05:50:55.078 WARNING:teuthology.provision.fog.smithi136:timed out 2023-08-31T05:51:01.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:51:01.444 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T05:51:01.445 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T05:51:01.706 INFO:teuthology.provision.fog.smithi136:Node is ready 2023-08-31T05:51:01.707 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2023-08-31T05:51:01.724 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136 2023-08-31T05:51:01.724 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136 /etc/hosts 2023-08-31T05:51:01.782 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2023-08-31T05:51:01.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-08-31T05:51:01.905 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hosts 2023-08-31T05:51:01.933 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2023-08-31T05:51:02.000 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hostname 2023-08-31T05:51:02.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-08-31T05:51:02.131 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-08-31T05:51:02.188 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T05:51:02.188 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T05:51:02.188 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-08-31T05:51:02.189 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-08-31T05:51:02.189 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-08-31T05:51:02.189 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-08-31T05:51:02.189 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T05:51:02.189 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-08-31T05:51:02.190 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T05:51:02.190 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T05:51:02.190 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T05:51:02.190 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T05:51:02.191 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-08-31T05:51:02.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T05:51:02.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T05:51:02.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T05:51:02.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T05:51:02.192 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2023-08-31T05:51:02.192 DEBUG:teuthology.parallel:result is None 2023-08-31T05:51:02.392 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-08-31T05:51:02.393 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T05:51:02.416 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2023-08-31T05:51:02.417 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T05:51:02.434 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-08-31T05:51:02.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-08-31T05:51:02.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:51:02.504 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-08-31T05:51:02.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-08-31T05:51:02.599 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-08-31T05:51:02.657 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-08-31T05:51:02.657 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-08-31T05:51:02.714 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T05:51:02.715 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T05:51:02.715 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-08-31T05:51:02.715 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-08-31T05:51:02.715 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-08-31T05:51:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-08-31T05:51:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T05:51:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-08-31T05:51:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T05:51:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T05:51:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T05:51:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T05:51:02.717 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-08-31T05:51:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T05:51:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T05:51:02.718 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T05:51:02.718 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T05:51:02.718 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-08-31T05:51:02.742 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2023-08-31T05:51:02.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-08-31T05:51:02.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T05:51:02.808 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-08-31T05:51:02.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-08-31T05:51:02.876 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-08-31T05:51:02.932 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-08-31T05:51:02.932 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-08-31T05:51:02.989 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T05:51:02.989 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T05:51:02.989 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-08-31T05:51:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-08-31T05:51:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-08-31T05:51:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-08-31T05:51:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T05:51:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-08-31T05:51:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T05:51:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T05:51:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T05:51:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T05:51:02.991 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-08-31T05:51:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T05:51:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T05:51:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T05:51:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T05:51:02.992 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-08-31T05:51:03.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T05:51:03.106 INFO:teuthology.dispatcher.supervisor:Running job 7385312 2023-08-31T05:51:03.106 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385312 --name vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385312/orig.config.yaml 2023-08-31T05:51:03.110 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385312 2023-08-31T05:51:03.110 INFO:teuthology.dispatcher.supervisor:Job PID: 3227368 2023-08-31T05:51:03.111 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-31T05:53:03.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T05:53:03.286 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-31T05:53:03.390 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385317 2023-08-31T05:53:03.390 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-31T05:53:03.390 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T05:53:03.438 DEBUG:teuthology.nuke:shortname: smithi060 2023-08-31T05:53:03.439 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T05:53:03.465 DEBUG:teuthology.nuke:shortname: smithi136 2023-08-31T05:53:03.465 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T05:53:03.468 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385312', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 05:45:52.031051', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T05:53:03.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385317', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 05:51:24.576188', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T05:53:03.520 INFO:teuthology.orchestra.console.smithi060:Power off 2023-08-31T05:53:03.520 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T05:53:03.542 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-08-31T05:53:03.542 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:53:03.560 INFO:teuthology.orchestra.console.smithi136:Power off 2023-08-31T05:53:03.560 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T05:53:03.569 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-08-31T05:53:03.582 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-08-31T05:53:03.582 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:53:03.604 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-31T05:53:03.671 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-08-31T05:53:03.819 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com 2023-08-31T05:53:07.606 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:53:07.715 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-31T05:53:11.718 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T05:53:11.826 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-31T05:53:11.927 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-08-31T05:53:12.086 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com