2023-09-23T16:28:59.485 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-23T16:28:59.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:28:59.741 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc781b3ee0>, signals=[15]) 2023-09-23T16:28:59.741 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-09-23T16:28:59.741 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-09-23T16:28:59.742 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-09-23T16:28:59.766 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-09-23T16:28:59.766 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-09-23T16:28:59.766 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-09-23T16:28:59.767 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-09-23T16:28:59.791 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-09-23T16:28:59.848 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-23T16:28:59.861 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-23T16:28:59.898 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-23T16:28:59.898 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 5} 2023-09-23T16:28:59.903 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-23T16:28:59.904 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5} 2023-09-23T16:28:59.936 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of rhel 8.6 2023-09-23T16:28:59.937 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:28:59.943 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-09-23T16:28:59.943 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:28:59.987 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-09-23T16:28:59.990 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-09-23T16:29:00.022 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-09-23T16:29:00.026 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-09-23T16:29:00.073 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:29:00.076 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:29:00.152 INFO:teuthology.orchestra.console.smithi169:Power off 2023-09-23T16:29:00.153 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T16:29:00.164 INFO:teuthology.orchestra.console.smithi049:Power off 2023-09-23T16:29:00.164 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T16:29:00.172 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-09-23T16:29:00.172 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:00.184 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-09-23T16:29:00.184 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:00.192 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-23T16:29:00.204 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-23T16:29:00.292 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-09-23T16:29:00.305 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-09-23T16:29:00.393 INFO:teuthology.orchestra.console.smithi169:Power on 2023-09-23T16:29:00.394 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-23T16:29:00.406 INFO:teuthology.orchestra.console.smithi049:Power on 2023-09-23T16:29:00.406 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-23T16:29:00.414 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-09-23T16:29:00.414 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:00.425 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-09-23T16:29:00.426 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:00.435 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-23T16:29:00.448 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-23T16:29:04.440 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:04.449 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:04.549 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-23T16:29:04.557 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-23T16:29:08.554 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:08.560 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T16:29:08.662 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-09-23T16:29:08.667 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-09-23T16:29:08.764 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-09-23T16:29:08.768 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-09-23T16:29:08.865 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-09-23T16:29:08.865 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:29:08.869 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-09-23T16:29:08.869 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:29:23.938 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:29:23.940 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:29:39.006 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:29:39.007 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:29:54.074 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:29:54.075 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:30:09.141 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:30:09.142 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:30:24.222 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:30:24.224 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:30:39.294 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:30:39.295 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:30:54.366 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:30:54.368 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:31:09.440 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:31:09.441 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:31:24.510 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:31:24.511 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:31:39.582 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:31:39.583 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:31:54.662 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-23T16:31:54.663 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:31:54.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:32:09.742 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:32:13.182 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-23T16:32:19.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:32:22.270 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-23T16:32:24.805 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:32:28.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:32:31.354 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-23T16:32:37.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:32:39.882 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-09-23T16:32:39.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:32:40.410 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-23T16:32:46.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:32:49.466 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-23T16:32:55.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:32:58.490 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:32:58.522 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-23T16:33:04.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:33:04.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:33:07.582 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:33:13.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:33:16.666 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:33:22.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:33:25.722 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:33:31.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:33:34.782 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:33:40.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:33:43.870 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:33:49.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:33:52.954 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:33:58.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:34:02.014 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-09-23T16:34:04.526 WARNING:teuthology.provision.fog.smithi169:timed out 2023-09-23T16:34:08.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:34:10.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:34:11.074 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-23T16:34:11.075 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-23T16:34:11.373 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-09-23T16:34:11.374 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-09-23T16:34:11.391 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-09-23T16:34:11.391 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-09-23T16:34:11.449 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-09-23T16:34:11.449 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-09-23T16:34:11.579 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-09-23T16:34:11.607 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-09-23T16:34:11.674 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-09-23T16:34:11.741 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-09-23T16:34:11.807 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-09-23T16:34:11.864 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-09-23T16:34:11.864 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-09-23T16:34:11.864 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-09-23T16:34:11.864 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-09-23T16:34:11.864 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-23T16:34:11.865 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-23T16:34:11.866 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-09-23T16:34:11.867 DEBUG:teuthology.parallel:result is None 2023-09-23T16:35:08.074 WARNING:teuthology.provision.fog.smithi049:timed out 2023-09-23T16:35:14.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:35:14.322 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-23T16:35:14.323 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-23T16:35:14.597 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-09-23T16:35:14.597 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-09-23T16:35:14.615 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-09-23T16:35:14.615 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-09-23T16:35:14.674 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-09-23T16:35:14.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-09-23T16:35:14.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-09-23T16:35:14.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-09-23T16:35:14.905 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-09-23T16:35:14.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-09-23T16:35:15.041 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-09-23T16:35:15.098 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-09-23T16:35:15.098 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T16:35:15.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-09-23T16:35:15.100 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T16:35:15.100 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-23T16:35:15.100 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-23T16:35:15.100 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-23T16:35:15.100 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-09-23T16:35:15.101 DEBUG:teuthology.parallel:result is None 2023-09-23T16:35:15.248 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2023-09-23T16:35:15.248 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-23T16:35:15.274 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-09-23T16:35:15.274 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-23T16:35:15.300 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2023-09-23T16:35:15.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-09-23T16:35:15.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:35:15.366 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-09-23T16:35:15.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-09-23T16:35:15.431 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-09-23T16:35:15.487 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-09-23T16:35:15.487 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-09-23T16:35:15.544 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-23T16:35:15.545 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T16:35:15.546 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-09-23T16:35:15.546 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T16:35:15.546 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-23T16:35:15.546 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-23T16:35:15.546 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-23T16:35:15.546 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-09-23T16:35:15.566 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-09-23T16:35:15.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-09-23T16:35:15.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T16:35:15.633 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-09-23T16:35:15.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-09-23T16:35:15.769 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-09-23T16:35:15.827 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-09-23T16:35:15.827 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-09-23T16:35:15.885 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-09-23T16:35:15.885 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-09-23T16:35:15.885 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-09-23T16:35:15.885 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-09-23T16:35:15.885 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-09-23T16:35:15.885 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-23T16:35:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-23T16:35:15.887 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-09-23T16:35:15.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:35:15.994 INFO:teuthology.dispatcher.supervisor:Running job 7401742 2023-09-23T16:35:15.994 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401742 --name teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401742/orig.config.yaml 2023-09-23T16:35:15.996 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401742 2023-09-23T16:35:15.997 INFO:teuthology.dispatcher.supervisor:Job PID: 3515469 2023-09-23T16:35:15.997 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-23T16:37:16.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:39:16.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:41:16.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:43:16.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:45:16.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:47:16.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:49:16.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:51:17.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:53:17.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:55:17.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:57:17.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T16:59:17.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:01:17.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:03:17.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:05:18.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:07:18.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:09:18.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:11:18.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:13:18.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:15:18.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:17:19.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:19:19.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:21:19.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:23:19.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:25:19.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:27:19.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:29:20.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:31:20.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:33:20.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:35:20.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:37:20.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:39:20.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:41:21.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:43:21.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:45:21.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:47:21.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:49:21.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:51:21.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:53:21.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:55:22.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T17:55:22.203 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-23T17:55:22.392 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-23T17:55:22.392 INFO:teuthology.nuke:Checking targets against current locks 2023-09-23T17:55:22.452 DEBUG:teuthology.nuke:shortname: smithi049 2023-09-23T17:55:22.452 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T17:55:22.478 DEBUG:teuthology.nuke:shortname: smithi169 2023-09-23T17:55:22.478 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T17:55:22.484 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 16:28:58.685311', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T17:55:22.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 16:28:58.683295', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T17:55:22.545 INFO:teuthology.orchestra.console.smithi049:Power off 2023-09-23T17:55:22.545 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T17:55:22.589 INFO:teuthology.orchestra.console.smithi169:Power off 2023-09-23T17:55:22.589 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T17:55:22.597 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-09-23T17:55:22.597 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T17:55:22.611 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-09-23T17:55:22.611 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T17:55:22.623 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-09-23T17:55:22.644 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-23T17:55:22.723 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-09-23T17:55:22.745 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-09-23T17:55:22.887 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-09-23T17:55:22.894 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com