2023-09-11T13:17:13.621 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-11T13:17:13.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:17:13.755 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe68f129670>, signals=[15]) 2023-09-11T13:17:13.756 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-09-11T13:17:13.757 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T13:17:13.757 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-09-11T13:17:13.780 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-09-11T13:17:13.780 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T13:17:13.781 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-09-11T13:17:13.783 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-09-11T13:17:13.804 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-09-11T13:17:13.855 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-11T13:17:13.874 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-11T13:17:13.902 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-11T13:17:13.902 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 5} 2023-09-11T13:17:13.920 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-11T13:17:13.920 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 5} 2023-09-11T13:17:13.946 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of rhel 8.6 2023-09-11T13:17:13.947 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:17:13.970 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6 2023-09-11T13:17:13.971 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:17:13.994 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T13:17:14.018 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T13:17:14.025 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-09-11T13:17:14.054 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-09-11T13:17:14.078 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:17:14.100 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:17:14.152 INFO:teuthology.orchestra.console.smithi049:Power off 2023-09-11T13:17:14.153 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T13:17:14.173 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-09-11T13:17:14.173 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:14.191 INFO:teuthology.orchestra.console.smithi148:Power off 2023-09-11T13:17:14.192 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T13:17:14.199 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-09-11T13:17:14.212 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-09-11T13:17:14.212 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:14.232 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-11T13:17:18.202 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:18.234 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:18.311 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-09-11T13:17:18.343 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-11T13:17:22.316 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:22.344 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:22.425 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-11T13:17:22.453 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-11T13:17:22.527 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-09-11T13:17:22.554 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-09-11T13:17:22.628 INFO:teuthology.orchestra.console.smithi049:Power on 2023-09-11T13:17:22.628 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T13:17:22.650 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-09-11T13:17:22.650 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:22.657 INFO:teuthology.orchestra.console.smithi148:Power on 2023-09-11T13:17:22.658 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T13:17:22.670 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-11T13:17:22.678 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-09-11T13:17:22.678 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:22.699 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-11T13:17:26.675 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:26.700 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:26.785 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-11T13:17:26.810 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-11T13:17:30.790 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:30.811 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:17:30.900 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-09-11T13:17:30.919 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-11T13:17:31.002 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-09-11T13:17:31.021 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-09-11T13:17:31.103 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-09-11T13:17:31.104 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:17:31.122 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-09-11T13:17:31.122 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:17:46.178 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:17:46.180 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:18:01.240 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:18:01.243 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:18:16.318 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:18:16.319 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:18:31.416 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:18:31.418 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:18:46.494 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:18:46.495 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:19:01.581 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:19:01.583 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:19:16.664 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:19:16.666 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:19:31.742 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:19:31.744 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:19:46.815 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:19:46.819 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:20:01.898 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:20:01.899 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:20:16.974 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-11T13:20:16.976 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:20:17.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:20:20.122 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-11T13:20:26.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:20:29.182 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-11T13:20:32.050 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:20:35.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:20:38.266 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-11T13:20:44.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:20:47.125 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:20:47.322 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-11T13:20:53.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:20:56.378 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-11T13:21:02.198 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-11T13:21:02.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:02.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:05.339 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:21:05.438 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-11T13:21:11.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:11.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:14.426 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:21:14.490 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-11T13:21:20.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:20.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:23.482 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:21:29.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:32.538 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:21:38.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:41.598 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:21:47.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:50.686 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:21:56.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:21:59.770 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:22:05.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:22:08.826 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:22:14.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:22:17.882 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:22:20.497 WARNING:teuthology.provision.fog.smithi148:timed out 2023-09-11T13:22:23.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:22:26.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:22:26.929 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T13:22:26.930 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T13:22:26.938 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-11T13:22:27.190 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-09-11T13:22:27.190 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-09-11T13:22:27.207 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 2023-09-11T13:22:27.208 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148 /etc/hosts 2023-09-11T13:22:27.269 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-09-11T13:22:27.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-09-11T13:22:27.388 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148/smithi148/g' /etc/hosts 2023-09-11T13:22:27.415 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-09-11T13:22:27.484 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148/smithi148/g' /etc/hostname 2023-09-11T13:22:27.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-09-11T13:22:27.620 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-09-11T13:22:27.679 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T13:22:27.679 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T13:22:27.680 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-09-11T13:22:27.680 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-09-11T13:22:27.680 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-09-11T13:22:27.680 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-09-11T13:22:27.680 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T13:22:27.681 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-09-11T13:22:27.681 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T13:22:27.681 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T13:22:27.681 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T13:22:27.682 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T13:22:27.682 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-11T13:22:27.682 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T13:22:27.682 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T13:22:27.683 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T13:22:27.683 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T13:22:27.684 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-09-11T13:22:27.685 DEBUG:teuthology.parallel:result is None 2023-09-11T13:22:32.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:23:33.002 WARNING:teuthology.provision.fog.smithi049:timed out 2023-09-11T13:23:39.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:23:39.354 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T13:23:39.354 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T13:23:39.661 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-09-11T13:23:39.661 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-09-11T13:23:39.680 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-09-11T13:23:39.680 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-09-11T13:23:39.739 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-09-11T13:23:39.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-09-11T13:23:39.907 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-09-11T13:23:39.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-09-11T13:23:40.006 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-09-11T13:23:40.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-09-11T13:23:40.142 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-09-11T13:23:40.200 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T13:23:40.201 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T13:23:40.201 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-09-11T13:23:40.201 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-09-11T13:23:40.201 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2023-09-11T13:23:40.202 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-09-11T13:23:40.202 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T13:23:40.202 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-09-11T13:23:40.202 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T13:23:40.202 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T13:23:40.203 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T13:23:40.203 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T13:23:40.203 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-09-11T13:23:40.203 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T13:23:40.203 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T13:23:40.204 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T13:23:40.204 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T13:23:40.204 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-09-11T13:23:40.205 DEBUG:teuthology.parallel:result is None 2023-09-11T13:23:40.356 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2023-09-11T13:23:40.357 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T13:23:40.381 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-09-11T13:23:40.381 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T13:23:40.398 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2023-09-11T13:23:40.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-09-11T13:23:40.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:23:40.465 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-09-11T13:23:40.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-09-11T13:23:40.535 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-09-11T13:23:40.591 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-09-11T13:23:40.591 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-09-11T13:23:40.647 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T13:23:40.648 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T13:23:40.648 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-09-11T13:23:40.648 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-09-11T13:23:40.648 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2023-09-11T13:23:40.649 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-09-11T13:23:40.649 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T13:23:40.649 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-09-11T13:23:40.649 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T13:23:40.650 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T13:23:40.650 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T13:23:40.650 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T13:23:40.650 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-09-11T13:23:40.650 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T13:23:40.651 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T13:23:40.651 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T13:23:40.651 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T13:23:40.652 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-09-11T13:23:40.673 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-09-11T13:23:40.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-11T13:23:40.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T13:23:40.740 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-09-11T13:23:40.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-11T13:23:40.873 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-09-11T13:23:40.932 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-09-11T13:23:40.932 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-09-11T13:23:40.990 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T13:23:40.990 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T13:23:40.991 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-09-11T13:23:40.991 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-09-11T13:23:40.991 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-09-11T13:23:40.991 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-09-11T13:23:40.991 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T13:23:40.992 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-09-11T13:23:40.992 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T13:23:40.992 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T13:23:40.992 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T13:23:40.992 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T13:23:40.993 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-11T13:23:40.993 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T13:23:40.993 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T13:23:40.993 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T13:23:40.993 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T13:23:40.994 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-09-11T13:23:41.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:23:41.114 INFO:teuthology.dispatcher.supervisor:Running job 7393538 2023-09-11T13:23:41.114 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393538 --name vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} -- /home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393538/orig.config.yaml 2023-09-11T13:23:41.117 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393538 2023-09-11T13:23:41.117 INFO:teuthology.dispatcher.supervisor:Job PID: 3351136 2023-09-11T13:23:41.118 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-11T13:25:41.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:27:41.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:29:41.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:31:41.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:33:41.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:35:41.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:37:42.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:39:42.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:41:42.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:43:42.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:45:42.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:47:42.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:49:43.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T13:49:43.185 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-11T13:49:43.292 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-11T13:49:43.292 INFO:teuthology.nuke:Checking targets against current locks 2023-09-11T13:49:43.341 DEBUG:teuthology.nuke:shortname: smithi049 2023-09-11T13:49:43.341 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T13:49:43.362 DEBUG:teuthology.nuke:shortname: smithi148 2023-09-11T13:49:43.362 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T13:49:43.366 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393538', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 13:17:12.864123', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-11T13:49:43.383 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393538', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 13:17:12.862491', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-11T13:49:43.408 INFO:teuthology.orchestra.console.smithi049:Power off 2023-09-11T13:49:43.409 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T13:49:43.430 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-09-11T13:49:43.431 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:49:43.443 INFO:teuthology.orchestra.console.smithi148:Power off 2023-09-11T13:49:43.444 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T13:49:43.452 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-11T13:49:43.463 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-09-11T13:49:43.478 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T13:49:43.498 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-11T13:49:43.553 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-09-11T13:49:43.600 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-09-11T13:49:43.701 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-09-11T13:49:43.743 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com