2023-08-28T02:36:03.901 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-28T02:36:03.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T02:36:04.036 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad47a09c10>, signals=[15]) 2023-08-28T02:36:04.037 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-08-28T02:36:04.037 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T02:36:04.037 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-08-28T02:36:04.054 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-08-28T02:36:04.054 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T02:36:04.054 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-08-28T02:36:04.056 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"} 2023-08-28T02:36:04.079 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-08-28T02:36:04.135 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-28T02:36:04.145 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-28T02:36:04.178 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-28T02:36:04.178 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 5} 2023-08-28T02:36:04.185 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-28T02:36:04.185 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 5} 2023-08-28T02:36:04.219 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.6 2023-08-28T02:36:04.219 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:36:04.231 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.6 2023-08-28T02:36:04.231 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:36:04.264 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T02:36:04.268 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T02:36:04.300 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1} 2023-08-28T02:36:04.305 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-08-28T02:36:04.361 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:36:04.377 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:36:04.438 INFO:teuthology.orchestra.console.smithi192:Power off 2023-08-28T02:36:04.438 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T02:36:04.450 INFO:teuthology.orchestra.console.smithi174:Power off 2023-08-28T02:36:04.451 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T02:36:04.460 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-08-28T02:36:04.460 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:04.470 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-08-28T02:36:04.470 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:04.480 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-28T02:36:04.490 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-28T02:36:08.485 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:08.491 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:08.594 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-28T02:36:08.599 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-28T02:36:12.599 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:12.606 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:12.708 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-28T02:36:12.714 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-28T02:36:12.809 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-08-28T02:36:12.910 INFO:teuthology.orchestra.console.smithi192:Power on 2023-08-28T02:36:12.910 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T02:36:12.930 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-08-28T02:36:12.931 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:12.951 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-28T02:36:16.717 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:16.825 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-08-28T02:36:16.926 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-08-28T02:36:16.952 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:17.027 INFO:teuthology.orchestra.console.smithi174:Power on 2023-08-28T02:36:17.027 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T02:36:17.048 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-08-28T02:36:17.048 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:17.060 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-28T02:36:17.068 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-08-28T02:36:21.065 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:21.071 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T02:36:21.181 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-28T02:36:21.188 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-28T02:36:21.282 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-08-28T02:36:21.289 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-08-28T02:36:21.383 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-08-28T02:36:21.383 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:36:21.390 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-08-28T02:36:21.390 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:36:36.452 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:36:36.454 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:36:51.521 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:36:51.522 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:37:06.589 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:37:06.591 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:37:21.647 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:37:21.654 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:37:36.709 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:37:36.711 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:37:51.769 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:37:51.771 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:38:06.830 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:38:06.832 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:38:21.890 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:38:21.891 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:38:36.958 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:38:36.960 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:38:52.017 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:38:52.018 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:39:07.076 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-28T02:39:07.078 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-28T02:39:07.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:07.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:25.547 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-28T02:39:25.547 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-28T02:39:31.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:31.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:34.635 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-28T02:39:34.635 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-28T02:39:40.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:40.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:43.723 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-28T02:39:43.723 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-28T02:39:49.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:49.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:52.811 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-28T02:39:52.811 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-28T02:39:58.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:39:58.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:40:01.899 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-28T02:40:07.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:40:58.867 WARNING:teuthology.provision.fog.smithi174:timed out 2023-08-28T02:41:04.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:41:05.202 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T02:41:05.203 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T02:41:05.495 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-08-28T02:41:05.495 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-08-28T02:41:05.514 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-08-28T02:41:05.514 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-08-28T02:41:05.572 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-08-28T02:41:05.572 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-08-28T02:41:05.689 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-08-28T02:41:05.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-08-28T02:41:05.785 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-08-28T02:41:05.852 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-08-28T02:41:05.917 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-28T02:41:05.974 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-28T02:41:05.975 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-28T02:41:05.976 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-08-28T02:41:05.977 DEBUG:teuthology.parallel:result is None 2023-08-28T02:41:07.909 WARNING:teuthology.provision.fog.smithi192:timed out 2023-08-28T02:41:13.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T02:41:14.253 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T02:41:14.253 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T02:41:14.541 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-08-28T02:41:14.541 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-08-28T02:41:14.559 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-08-28T02:41:14.559 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts