2023-08-10T10:31:46.586 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T10:31:46.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:31:46.732 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f318f321ee0>, signals=[15]) 2023-08-10T10:31:46.734 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-08-10T10:31:46.735 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T10:31:46.735 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-08-10T10:31:46.754 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-08-10T10:31:46.755 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T10:31:46.755 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-10T10:31:46.756 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-08-10T10:31:46.779 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-08-10T10:31:46.827 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-10T10:31:46.842 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-10T10:31:46.863 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-10T10:31:46.863 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 5} 2023-08-10T10:31:46.882 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-10T10:31:46.882 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 5} 2023-08-10T10:31:46.913 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of rhel 8.6 2023-08-10T10:31:46.914 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:31:46.924 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.6 2023-08-10T10:31:46.924 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:31:46.966 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T10:31:46.974 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T10:31:47.001 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-08-10T10:31:47.012 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-08-10T10:31:47.076 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:31:47.084 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:31:47.171 INFO:teuthology.orchestra.console.smithi049:Power off 2023-08-10T10:31:47.172 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:31:47.187 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-10T10:31:47.188 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:31:47.197 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-08-10T10:31:47.198 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:31:47.208 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-10T10:31:47.209 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:31:47.217 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-10T10:31:47.228 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-10T10:31:47.319 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-08-10T10:31:47.329 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-10T10:31:47.421 INFO:teuthology.orchestra.console.smithi049:Power on 2023-08-10T10:31:47.422 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T10:31:47.431 INFO:teuthology.orchestra.console.smithi116:Power on 2023-08-10T10:31:47.431 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T10:31:47.441 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-08-10T10:31:47.442 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:31:47.452 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-08-10T10:31:47.453 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:31:47.464 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-10T10:31:47.478 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-10T10:31:51.470 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:31:51.480 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:31:51.581 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-10T10:31:51.590 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-10T10:31:51.682 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-08-10T10:31:51.783 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-08-10T10:31:51.784 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:31:55.592 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:31:55.702 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-08-10T10:31:55.803 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-08-10T10:31:55.904 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-08-10T10:31:55.904 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:32:06.866 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:32:10.984 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:32:21.948 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:32:26.054 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:32:37.024 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:32:41.144 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:32:52.100 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:32:56.206 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:33:07.184 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:33:11.300 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:33:22.259 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:33:26.388 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:33:37.335 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:33:41.468 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:33:52.412 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:33:56.540 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:34:07.488 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:34:11.616 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:34:22.580 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:34:26.688 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-10T10:34:26.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:29.808 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-10T10:34:35.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:37.642 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:34:38.868 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-10T10:34:44.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:47.952 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-10T10:34:52.703 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:34:53.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:57.008 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-10T10:35:03.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:06.064 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-10T10:35:07.768 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:35:12.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:15.120 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-10T10:35:21.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:22.823 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-10T10:35:22.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:24.176 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-10T10:35:25.936 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:35:30.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:31.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:34.996 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:35:41.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:44.084 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:35:50.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:53.168 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:35:59.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:36:02.228 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:36:08.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:36:11.312 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:36:17.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:36:20.400 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:36:26.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:36:29.488 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:36:30.183 WARNING:teuthology.provision.fog.smithi116:timed out 2023-08-10T10:36:35.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:36:36.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:36:36.510 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T10:36:36.511 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T10:36:36.776 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-08-10T10:36:36.777 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-08-10T10:36:36.794 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116 2023-08-10T10:36:36.795 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116 /etc/hosts 2023-08-10T10:36:36.850 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-08-10T10:36:36.850 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-10T10:36:36.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116/smithi116/g' /etc/hosts 2023-08-10T10:36:36.982 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-08-10T10:36:37.047 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116/smithi116/g' /etc/hostname 2023-08-10T10:36:37.114 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-10T10:36:37.179 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-10T10:36:37.233 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:36:37.234 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:36:37.234 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-08-10T10:36:37.234 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-08-10T10:36:37.234 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2023-08-10T10:36:37.234 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:36:37.235 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:36:37.235 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-10T10:36:37.235 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:36:37.235 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:36:37.235 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:36:37.235 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:36:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-08-10T10:36:37.236 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:36:37.236 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:36:37.236 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:36:37.236 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:36:37.237 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-08-10T10:36:37.238 DEBUG:teuthology.parallel:result is None 2023-08-10T10:36:38.548 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-10T10:36:44.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:37:44.612 WARNING:teuthology.provision.fog.smithi049:timed out 2023-08-10T10:37:50.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:37:50.961 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T10:37:50.961 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T10:37:51.285 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-08-10T10:37:51.285 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-08-10T10:37:51.303 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-08-10T10:37:51.304 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-08-10T10:37:51.362 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-08-10T10:37:51.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-08-10T10:37:51.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-08-10T10:37:51.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-08-10T10:37:51.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-08-10T10:37:51.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-08-10T10:37:51.739 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-08-10T10:37:51.795 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:37:51.796 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:37:51.796 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-08-10T10:37:51.796 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-08-10T10:37:51.796 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2023-08-10T10:37:51.796 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:37:51.797 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:37:51.797 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-08-10T10:37:51.797 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:37:51.797 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:37:51.797 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:37:51.797 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:37:51.797 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-08-10T10:37:51.798 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:37:51.798 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:37:51.798 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:37:51.798 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:37:51.798 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-08-10T10:37:51.799 DEBUG:teuthology.parallel:result is None 2023-08-10T10:37:51.943 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2023-08-10T10:37:51.944 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T10:37:51.972 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-08-10T10:37:51.972 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T10:37:51.999 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2023-08-10T10:37:52.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-08-10T10:37:52.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:37:52.066 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-08-10T10:37:52.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-08-10T10:37:52.134 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-08-10T10:37:52.192 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-08-10T10:37:52.192 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-08-10T10:37:52.248 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:37:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:37:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-08-10T10:37:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-08-10T10:37:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2023-08-10T10:37:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:37:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:37:52.250 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-08-10T10:37:52.250 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:37:52.250 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:37:52.250 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:37:52.250 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:37:52.250 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-08-10T10:37:52.250 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:37:52.251 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:37:52.251 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:37:52.251 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:37:52.251 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-08-10T10:37:52.271 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-08-10T10:37:52.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-10T10:37:52.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:37:52.339 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-08-10T10:37:52.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-10T10:37:52.474 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-08-10T10:37:52.531 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-08-10T10:37:52.531 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-10T10:37:52.587 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:37:52.587 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:37:52.588 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-08-10T10:37:52.588 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-08-10T10:37:52.588 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2023-08-10T10:37:52.588 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:37:52.588 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:37:52.588 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-10T10:37:52.588 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:37:52.589 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:37:52.590 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-10T10:37:52.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:37:52.720 INFO:teuthology.dispatcher.supervisor:Running job 7364569 2023-08-10T10:37:52.721 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364569 --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364569/orig.config.yaml 2023-08-10T10:37:52.727 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364569 2023-08-10T10:37:52.728 INFO:teuthology.dispatcher.supervisor:Job PID: 15706 2023-08-10T10:37:52.728 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-10T10:39:52.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:41:53.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:43:53.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:45:53.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:47:53.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:49:53.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:51:53.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:53:54.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:55:54.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:57:54.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:57:54.400 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-10T10:57:54.512 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-10T10:57:54.513 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T10:57:54.559 DEBUG:teuthology.nuke:shortname: smithi049 2023-08-10T10:57:54.560 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:57:54.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 10:31:45.771683', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-10T10:57:54.588 DEBUG:teuthology.nuke:shortname: smithi116 2023-08-10T10:57:54.588 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:57:54.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 10:31:45.769824', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T10:57:54.630 INFO:teuthology.orchestra.console.smithi049:Power off 2023-08-10T10:57:54.630 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:57:54.650 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-08-10T10:57:54.651 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:57:54.668 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-10T10:57:54.669 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:57:54.677 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-10T10:57:54.690 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-10T10:57:54.690 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:57:54.710 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-10T10:57:54.779 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-08-10T10:57:54.811 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-10T10:57:54.923 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-08-10T10:57:54.957 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com