2023-10-06T05:06:09.624 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T05:06:09.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:06:09.757 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9c195d9670>, signals=[15]) 2023-10-06T05:06:09.757 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-10-06T05:06:09.758 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T05:06:09.758 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-06T05:06:09.771 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-10-06T05:06:09.771 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T05:06:09.771 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-06T05:06:09.773 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-10-06T05:06:09.788 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-10-06T05:06:09.842 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-06T05:06:09.845 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-06T05:06:09.888 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-06T05:06:09.888 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 7} 2023-10-06T05:06:09.891 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-06T05:06:09.891 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 7} 2023-10-06T05:06:09.930 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.4 2023-10-06T05:06:09.930 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:06:09.933 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.4 2023-10-06T05:06:09.933 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:06:09.988 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T05:06:09.991 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T05:06:10.025 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-10-06T05:06:10.026 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-10-06T05:06:10.083 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:06:10.086 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:06:10.175 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-06T05:06:10.176 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T05:06:10.188 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-06T05:06:10.189 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T05:06:10.198 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-06T05:06:10.198 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:10.210 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-06T05:06:10.210 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:10.219 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-06T05:06:10.234 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-06T05:06:14.222 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:14.235 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:14.330 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-06T05:06:14.342 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-06T05:06:18.334 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:18.343 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:18.443 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-06T05:06:18.451 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-06T05:06:18.545 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-06T05:06:18.645 INFO:teuthology.orchestra.console.smithi157:Power on 2023-10-06T05:06:18.646 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T05:06:18.666 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-10-06T05:06:18.667 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:18.687 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-06T05:06:22.456 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:22.564 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-06T05:06:22.665 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-06T05:06:22.688 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:22.766 INFO:teuthology.orchestra.console.smithi132:Power on 2023-10-06T05:06:22.766 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T05:06:22.786 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-10-06T05:06:22.786 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:22.797 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-06T05:06:22.808 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-06T05:06:26.798 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:26.809 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:26.907 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-06T05:06:26.916 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-06T05:06:27.009 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-10-06T05:06:27.109 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-10-06T05:06:27.110 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:06:30.918 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:06:31.026 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-06T05:06:31.127 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-10-06T05:06:31.227 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-10-06T05:06:31.228 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:06:42.198 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:06:46.294 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:06:57.286 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:07:01.378 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:07:12.362 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:07:16.442 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:07:27.446 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:07:31.510 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:07:42.517 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:07:46.586 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:07:57.609 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:08:01.658 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:08:12.694 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:08:16.750 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:08:27.774 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:08:31.816 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:08:42.870 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:08:46.894 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:08:57.959 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:09:01.978 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:09:13.054 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:09:17.071 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-06T05:09:17.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:09:28.163 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-06T05:09:28.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:09:35.486 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-06T05:09:41.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:09:44.574 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-06T05:09:46.746 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-06T05:09:50.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:09:52.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:09:53.658 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-06T05:09:55.806 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-06T05:09:59.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:10:01.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:10:02.714 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-06T05:10:04.890 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-06T05:10:08.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:10:10.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:10:13.946 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-06T05:10:19.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:10:23.002 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-06T05:10:29.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:10:32.058 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-06T05:10:38.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:10:41.117 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-06T05:10:47.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:11:08.742 WARNING:teuthology.provision.fog.smithi132:timed out 2023-10-06T05:11:14.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:11:15.099 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T05:11:15.099 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T05:11:15.358 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-10-06T05:11:15.359 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-10-06T05:11:15.414 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-10-06T05:11:15.414 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-10-06T05:11:15.470 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-10-06T05:11:15.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-06T05:11:15.608 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-10-06T05:11:15.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-10-06T05:11:15.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-10-06T05:11:15.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-06T05:11:15.828 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-06T05:11:15.883 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T05:11:15.883 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T05:11:15.883 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2023-10-06T05:11:15.883 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2023-10-06T05:11:15.883 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4" 2023-10-06T05:11:15.883 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-10-06T05:11:15.883 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T05:11:15.884 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T05:11:15.885 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-10-06T05:11:15.886 DEBUG:teuthology.parallel:result is None 2023-10-06T05:11:47.154 WARNING:teuthology.provision.fog.smithi157:timed out 2023-10-06T05:11:53.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:11:53.502 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T05:11:53.502 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T05:11:53.772 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-10-06T05:11:53.772 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-10-06T05:11:53.829 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-10-06T05:11:53.829 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-10-06T05:11:53.884 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-10-06T05:11:53.885 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-10-06T05:11:53.999 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-10-06T05:11:54.025 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-10-06T05:11:54.090 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-10-06T05:11:54.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-10-06T05:11:54.218 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-06T05:11:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T05:11:54.274 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T05:11:54.274 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-10-06T05:11:54.275 DEBUG:teuthology.parallel:result is None 2023-10-06T05:11:54.420 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-10-06T05:11:54.421 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T05:11:54.448 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-10-06T05:11:54.448 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T05:11:54.474 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-10-06T05:11:54.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-06T05:11:54.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:11:54.541 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-10-06T05:11:54.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-06T05:11:54.657 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-10-06T05:11:54.711 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-10-06T05:11:54.711 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-06T05:11:54.765 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T05:11:54.765 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T05:11:54.765 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2023-10-06T05:11:54.765 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2023-10-06T05:11:54.765 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-10-06T05:11:54.766 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T05:11:54.767 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T05:11:54.767 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T05:11:54.767 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T05:11:54.767 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-06T05:11:54.790 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-10-06T05:11:54.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-06T05:11:54.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:11:54.855 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-10-06T05:11:54.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-06T05:11:54.921 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-10-06T05:11:54.975 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-10-06T05:11:54.976 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-06T05:11:55.031 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T05:11:55.052 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T05:11:55.053 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-06T05:11:55.054 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T05:11:55.054 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T05:11:55.054 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T05:11:55.054 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T05:11:55.054 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-06T05:11:55.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:11:55.167 INFO:teuthology.dispatcher.supervisor:Running job 7412335 2023-10-06T05:11:55.168 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412335 --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412335/orig.config.yaml 2023-10-06T05:11:55.170 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412335 2023-10-06T05:11:55.171 INFO:teuthology.dispatcher.supervisor:Job PID: 2164016 2023-10-06T05:11:55.171 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-06T05:13:55.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:15:55.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:17:55.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:19:55.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:21:55.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:23:56.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:25:56.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:27:56.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:29:56.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:31:56.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:33:56.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:35:57.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:35:57.152 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-06T05:35:57.257 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-06T05:35:57.258 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T05:35:57.309 DEBUG:teuthology.nuke:shortname: smithi132 2023-10-06T05:35:57.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T05:35:57.323 DEBUG:teuthology.nuke:shortname: smithi157 2023-10-06T05:35:57.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T05:35:57.329 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412335', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:06:08.818512', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNVQQ10wc1wI9bKdzdgnVav3BY9krKEMY9ANrcF26eL0wfHR4aOYttzqcrqvT6POc/4p1FBD6P1ANbMdnKS5HMg='} 2023-10-06T05:35:57.344 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412335', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:06:08.820088', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBArxKeQleJbLYWWMTXKM0HhI0jr1hwkRP3aF+36NOq2gOxZn+W2j3p4a8T3dOSALFDIpQZkIqz/lACqwUqw5LWs='} 2023-10-06T05:35:57.376 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-06T05:35:57.376 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T05:35:57.397 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-06T05:35:57.397 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:35:57.409 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-06T05:35:57.410 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T05:35:57.422 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-06T05:35:57.430 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-06T05:35:57.430 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:35:57.453 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-06T05:35:57.523 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-06T05:35:57.554 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-06T05:35:57.677 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2023-10-06T05:35:57.692 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com