2023-10-20T12:28:59.829 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-20T12:28:59.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:28:59.973 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c423d2ee0>, signals=[15]) 2023-10-20T12:28:59.976 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-10-20T12:28:59.976 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:28:59.978 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-10-20T12:29:00.001 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-10-20T12:29:00.001 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:29:00.001 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-20T12:29:00.003 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-10-20T12:29:00.025 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-10-20T12:29:00.085 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-20T12:29:00.104 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-20T12:29:00.126 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-20T12:29:00.126 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 5} 2023-10-20T12:29:00.149 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-20T12:29:00.149 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 5} 2023-10-20T12:29:00.184 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6 2023-10-20T12:29:00.184 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:29:00.190 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.6 2023-10-20T12:29:00.191 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:29:00.233 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:29:00.236 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:29:00.269 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-10-20T12:29:00.275 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-10-20T12:29:00.330 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:29:00.333 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:29:00.440 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-20T12:29:00.441 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:29:00.453 INFO:teuthology.orchestra.console.smithi111:Power off 2023-10-20T12:29:00.454 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:29:00.463 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-20T12:29:00.464 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:00.475 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-10-20T12:29:00.476 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:00.485 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-20T12:29:00.499 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-10-20T12:29:04.490 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:04.500 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:04.599 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-20T12:29:04.609 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-10-20T12:29:08.603 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:08.611 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:08.713 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-20T12:29:08.719 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-10-20T12:29:08.815 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-20T12:29:08.915 INFO:teuthology.orchestra.console.smithi139:Power on 2023-10-20T12:29:08.916 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:29:08.937 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-10-20T12:29:08.938 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:08.958 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-20T12:29:12.722 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:12.831 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-10-20T12:29:12.932 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-10-20T12:29:12.959 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:13.034 INFO:teuthology.orchestra.console.smithi111:Power on 2023-10-20T12:29:13.035 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:29:13.056 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2023-10-20T12:29:13.056 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:13.068 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-20T12:29:13.076 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-10-20T12:29:17.071 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:17.078 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:17.180 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-20T12:29:17.186 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-10-20T12:29:17.281 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-10-20T12:29:17.382 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-10-20T12:29:17.382 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:29:21.190 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:29:21.299 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-10-20T12:29:21.400 INFO:teuthology.orchestra.console.smithi111:Power on completed 2023-10-20T12:29:21.501 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-10-20T12:29:21.501 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:29:32.458 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:29:36.558 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:29:47.522 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:29:51.610 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:30:02.582 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:30:06.666 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:30:17.647 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:30:21.726 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:30:32.714 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:30:36.786 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:30:47.786 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:30:51.850 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:31:02.866 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:31:06.910 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:31:17.940 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:31:21.978 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:31:33.014 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:31:37.051 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:31:48.097 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:31:52.118 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:32:03.184 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-20T12:32:03.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:07.186 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:32:21.627 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-20T12:32:22.257 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-10-20T12:32:22.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:27.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:30.714 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-20T12:32:36.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:39.770 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-20T12:32:40.826 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-20T12:32:45.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:46.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:48.826 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-20T12:32:49.882 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-20T12:32:54.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:55.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:32:58.938 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-20T12:33:04.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:33:07.994 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-20T12:33:13.338 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-20T12:33:13.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:33:17.054 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-20T12:33:19.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:33:22.398 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-20T12:33:23.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:33:28.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:33:30.311 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:33:30.312 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:33:30.807 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-10-20T12:33:30.807 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-10-20T12:33:30.823 INFO:teuthology.orchestra.run.smithi139.stdout:smithi022 2023-10-20T12:33:30.824 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi022 /etc/hosts 2023-10-20T12:33:30.880 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-20T12:33:30.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-20T12:33:31.077 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi022/smithi139/g' /etc/hosts 2023-10-20T12:33:31.103 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.22/172.21.15.139/g' /etc/hosts 2023-10-20T12:33:31.176 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi022/smithi139/g' /etc/hostname 2023-10-20T12:33:31.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-20T12:33:31.326 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-20T12:33:31.382 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-10-20T12:33:31.383 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-10-20T12:33:31.383 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-10-20T12:33:31.383 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-10-20T12:33:31.383 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-10-20T12:33:31.383 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:33:31.384 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-20T12:33:31.384 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-20T12:33:31.384 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-20T12:33:31.384 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-10-20T12:33:31.384 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-20T12:33:31.385 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:33:31.385 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-20T12:33:31.385 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:33:31.385 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-20T12:33:31.385 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-20T12:33:31.386 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-20T12:33:31.386 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-10-20T12:33:31.388 DEBUG:teuthology.parallel:result is None 2023-10-20T12:34:23.109 WARNING:teuthology.provision.fog.smithi111:timed out 2023-10-20T12:34:29.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:34:29.447 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:34:29.448 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:34:29.763 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-10-20T12:34:29.764 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-10-20T12:34:29.781 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-10-20T12:34:29.781 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-10-20T12:34:29.839 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-10-20T12:34:29.839 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-10-20T12:34:29.946 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-10-20T12:34:29.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-10-20T12:34:30.042 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-10-20T12:34:30.110 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-10-20T12:34:30.175 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-10-20T12:34:30.232 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux" 2023-10-20T12:34:30.233 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)" 2023-10-20T12:34:30.233 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel" 2023-10-20T12:34:30.233 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora" 2023-10-20T12:34:30.233 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6" 2023-10-20T12:34:30.234 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:34:30.234 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-20T12:34:30.234 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-10-20T12:34:30.234 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-20T12:34:30.234 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/" 2023-10-20T12:34:30.235 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-20T12:34:30.235 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:34:30.235 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-20T12:34:30.235 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:34:30.235 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-20T12:34:30.236 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-20T12:34:30.236 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-20T12:34:30.236 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-10-20T12:34:30.237 DEBUG:teuthology.parallel:result is None 2023-10-20T12:34:30.393 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-10-20T12:34:30.394 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:34:30.419 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-10-20T12:34:30.419 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:34:30.436 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:34:30.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-20T12:34:30.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:34:30.501 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-10-20T12:34:30.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-20T12:34:30.570 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-10-20T12:34:30.626 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-10-20T12:34:30.626 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-10-20T12:34:30.682 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux" 2023-10-20T12:34:30.682 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)" 2023-10-20T12:34:30.682 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel" 2023-10-20T12:34:30.683 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora" 2023-10-20T12:34:30.683 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6" 2023-10-20T12:34:30.683 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:34:30.683 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-20T12:34:30.683 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-10-20T12:34:30.684 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-20T12:34:30.684 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/" 2023-10-20T12:34:30.684 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-20T12:34:30.684 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:34:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-20T12:34:30.685 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:34:30.685 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-20T12:34:30.685 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-20T12:34:30.685 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-20T12:34:30.686 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-10-20T12:34:30.710 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:34:30.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-20T12:34:30.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:34:30.777 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-10-20T12:34:30.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-20T12:34:30.916 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-10-20T12:34:30.973 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-10-20T12:34:30.974 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-20T12:34:31.030 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-10-20T12:34:31.030 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-10-20T12:34:31.031 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-10-20T12:34:31.031 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-10-20T12:34:31.031 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-10-20T12:34:31.031 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:34:31.031 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-20T12:34:31.032 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-20T12:34:31.032 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-20T12:34:31.032 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-10-20T12:34:31.032 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-20T12:34:31.032 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:34:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-20T12:34:31.033 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:34:31.033 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-20T12:34:31.033 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-20T12:34:31.033 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-20T12:34:31.034 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-20T12:34:31.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:34:31.141 INFO:teuthology.dispatcher.supervisor:Running job 7427595 2023-10-20T12:34:31.141 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427595 --name teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427595/orig.config.yaml 2023-10-20T12:34:31.145 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427595 2023-10-20T12:34:31.146 INFO:teuthology.dispatcher.supervisor:Job PID: 1860198 2023-10-20T12:34:31.146 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-20T12:36:31.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:38:31.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:40:31.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:42:31.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:44:31.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:46:32.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:48:32.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:50:32.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:52:32.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:54:32.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:56:32.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:58:33.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:00:33.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:02:33.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:04:33.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:06:33.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:08:33.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:10:34.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:12:34.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:14:34.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:16:34.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:18:34.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:20:34.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:22:34.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:24:35.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:26:35.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:28:35.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:30:35.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:32:35.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:34:35.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:36:35.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:38:36.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:40:36.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:42:36.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:44:36.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:46:36.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:48:36.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:50:36.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:52:37.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:54:37.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:56:37.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:56:37.548 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-20T13:56:37.742 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-20T13:56:37.743 INFO:teuthology.nuke:Checking targets against current locks 2023-10-20T13:56:37.793 DEBUG:teuthology.nuke:shortname: smithi111 2023-10-20T13:56:37.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T13:56:37.812 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:28:59.010495', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-20T13:56:37.815 DEBUG:teuthology.nuke:shortname: smithi139 2023-10-20T13:56:37.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T13:56:37.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:28:59.008990', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-20T13:56:37.865 INFO:teuthology.orchestra.console.smithi111:Power off 2023-10-20T13:56:37.865 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T13:56:37.886 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-10-20T13:56:37.887 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T13:56:37.900 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-20T13:56:37.900 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T13:56:37.910 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-10-20T13:56:37.923 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-20T13:56:37.923 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T13:56:37.945 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-20T13:56:38.011 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-10-20T13:56:38.046 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-20T13:56:38.165 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2023-10-20T13:56:38.199 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com