2023-08-30T22:52:50.800 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T22:52:50.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:52:50.959 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f063219d670>, signals=[15]) 2023-08-30T22:52:50.960 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-08-30T22:52:50.960 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:52:50.961 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-30T22:52:50.986 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-08-30T22:52:50.987 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:52:50.987 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-08-30T22:52:50.988 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-08-30T22:52:51.011 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-08-30T22:52:51.063 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-30T22:52:51.075 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-30T22:52:51.101 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-30T22:52:51.102 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 5} 2023-08-30T22:52:51.117 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-30T22:52:51.117 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 5} 2023-08-30T22:52:51.149 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.6 2023-08-30T22:52:51.149 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:52:51.162 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6 2023-08-30T22:52:51.162 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:52:51.245 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:52:51.252 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:52:51.289 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-08-30T22:52:51.294 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-08-30T22:52:51.365 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:52:51.381 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:52:51.509 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-30T22:52:51.510 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:52:51.525 INFO:teuthology.orchestra.console.smithi145:Power off 2023-08-30T22:52:51.525 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:52:51.535 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-30T22:52:51.536 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:52:51.547 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-08-30T22:52:51.547 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:52:51.558 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-30T22:52:51.572 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-30T22:52:51.661 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-30T22:52:51.673 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-08-30T22:52:51.762 INFO:teuthology.orchestra.console.smithi104:Power on 2023-08-30T22:52:51.763 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:52:51.774 INFO:teuthology.orchestra.console.smithi145:Power on 2023-08-30T22:52:51.775 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:52:51.783 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2023-08-30T22:52:51.784 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:52:51.796 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2023-08-30T22:52:51.797 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:52:51.805 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-30T22:52:51.819 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-30T22:52:55.810 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:52:55.820 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:52:55.918 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-08-30T22:52:55.929 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-30T22:52:56.019 INFO:teuthology.orchestra.console.smithi104:Power on completed 2023-08-30T22:52:56.120 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-08-30T22:52:56.121 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:52:59.934 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:53:00.042 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-08-30T22:53:00.143 INFO:teuthology.orchestra.console.smithi145:Power on completed 2023-08-30T22:53:00.244 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-08-30T22:53:00.245 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:53:11.238 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:53:15.354 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:53:26.360 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:53:30.466 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:53:41.458 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:53:45.562 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:53:56.563 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:54:00.670 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:54:11.675 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:54:15.774 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:54:26.802 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:54:30.898 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:54:41.934 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:54:46.010 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:54:57.042 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:55:01.114 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:55:12.138 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:55:16.206 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:55:27.244 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:55:31.290 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:55:42.334 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T22:55:42.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:55:45.498 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:55:46.372 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-30T22:55:46.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:55:49.534 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-30T22:55:51.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:55:54.591 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:55:55.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:55:58.622 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-30T22:56:00.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:03.678 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:56:04.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:07.708 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-30T22:56:09.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:12.766 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:56:13.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:16.764 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-30T22:56:18.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:21.851 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:56:22.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:25.850 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-30T22:56:27.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:30.906 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:56:31.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:34.906 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-30T22:56:36.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:40.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:56:55.450 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:57:01.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:57:04.506 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:57:10.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:57:13.598 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T22:57:19.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:57:19.917 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:57:19.918 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:57:20.163 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-08-30T22:57:20.164 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-08-30T22:57:20.181 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-08-30T22:57:20.181 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-08-30T22:57:20.238 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-08-30T22:57:20.239 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-30T22:57:20.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-08-30T22:57:20.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-08-30T22:57:20.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-08-30T22:57:20.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-30T22:57:20.577 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-30T22:57:20.634 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2023-08-30T22:57:20.635 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2023-08-30T22:57:20.636 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2023-08-30T22:57:20.636 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2023-08-30T22:57:20.637 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2023-08-30T22:57:20.637 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:57:20.637 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-30T22:57:20.637 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-08-30T22:57:20.637 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-30T22:57:20.638 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2023-08-30T22:57:20.638 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-30T22:57:20.638 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:57:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-08-30T22:57:20.638 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:57:20.639 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-30T22:57:20.639 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-30T22:57:20.639 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-30T22:57:20.640 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-08-30T22:57:20.641 DEBUG:teuthology.parallel:result is None 2023-08-30T22:57:40.930 WARNING:teuthology.provision.fog.smithi145:timed out 2023-08-30T22:57:46.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:57:47.266 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:57:47.266 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:57:47.591 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-08-30T22:57:47.591 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-08-30T22:57:47.612 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145 2023-08-30T22:57:47.612 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145 /etc/hosts 2023-08-30T22:57:47.675 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-08-30T22:57:47.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-08-30T22:57:47.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hosts 2023-08-30T22:57:47.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-08-30T22:57:47.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hostname 2023-08-30T22:57:47.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-08-30T22:57:48.028 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-08-30T22:57:48.083 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-08-30T22:57:48.084 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-08-30T22:57:48.084 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-08-30T22:57:48.084 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-08-30T22:57:48.085 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-08-30T22:57:48.085 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:57:48.086 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-30T22:57:48.086 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-08-30T22:57:48.086 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-30T22:57:48.087 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-08-30T22:57:48.087 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-30T22:57:48.087 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:57:48.087 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-08-30T22:57:48.087 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:57:48.087 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-30T22:57:48.088 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-30T22:57:48.088 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-30T22:57:48.088 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-08-30T22:57:48.089 DEBUG:teuthology.parallel:result is None 2023-08-30T22:57:48.246 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-08-30T22:57:48.247 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:57:48.273 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-08-30T22:57:48.274 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:57:48.301 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:57:48.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-30T22:57:48.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:57:48.375 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-08-30T22:57:48.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-30T22:57:48.506 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-08-30T22:57:48.563 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-08-30T22:57:48.563 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-30T22:57:48.621 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2023-08-30T22:57:48.621 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2023-08-30T22:57:48.621 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2023-08-30T22:57:48.622 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2023-08-30T22:57:48.622 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2023-08-30T22:57:48.622 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:57:48.622 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-30T22:57:48.623 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-08-30T22:57:48.623 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-30T22:57:48.623 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2023-08-30T22:57:48.623 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-30T22:57:48.623 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:57:48.624 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-08-30T22:57:48.624 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:57:48.624 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-30T22:57:48.624 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-30T22:57:48.624 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-30T22:57:48.625 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-30T22:57:48.657 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:57:48.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-08-30T22:57:48.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:57:48.723 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-08-30T22:57:48.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-08-30T22:57:48.791 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-08-30T22:57:48.847 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-08-30T22:57:48.847 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-08-30T22:57:48.904 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-08-30T22:57:48.904 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-08-30T22:57:48.904 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-08-30T22:57:48.904 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-08-30T22:57:48.905 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-08-30T22:57:48.905 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:57:48.905 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-30T22:57:48.906 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-08-30T22:57:48.907 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-30T22:57:48.907 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-08-30T22:57:48.907 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-30T22:57:48.907 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:57:48.907 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-08-30T22:57:48.908 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:57:48.908 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-30T22:57:48.908 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-30T22:57:48.908 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-30T22:57:48.909 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-08-30T22:57:48.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:57:49.033 INFO:teuthology.dispatcher.supervisor:Running job 7384835 2023-08-30T22:57:49.034 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384835 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384835/orig.config.yaml 2023-08-30T22:57:49.038 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384835 2023-08-30T22:57:49.039 INFO:teuthology.dispatcher.supervisor:Job PID: 3266609 2023-08-30T22:57:49.039 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T22:59:49.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:01:49.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:03:49.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:05:49.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:07:49.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:09:50.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:11:50.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:11:50.403 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T23:11:50.528 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T23:11:50.529 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T23:11:50.572 DEBUG:teuthology.nuke:shortname: smithi104 2023-08-30T23:11:50.573 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:11:50.603 DEBUG:teuthology.nuke:shortname: smithi145 2023-08-30T23:11:50.603 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:11:50.604 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384835', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:52:49.941740', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-30T23:11:50.631 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384835', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:52:49.943473', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-30T23:11:50.659 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-30T23:11:50.660 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:11:50.681 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-30T23:11:50.682 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:11:50.697 INFO:teuthology.orchestra.console.smithi145:Power off 2023-08-30T23:11:50.697 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:11:50.705 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-30T23:11:50.717 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-08-30T23:11:50.717 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:11:50.740 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-30T23:11:50.806 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-30T23:11:50.842 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-08-30T23:11:50.951 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-08-30T23:11:50.984 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com