2023-09-27T23:08:24.564 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-27T23:08:24.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:08:24.697 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f634565f670>, signals=[15]) 2023-09-27T23:08:24.698 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-09-27T23:08:24.698 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-09-27T23:08:24.698 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-09-27T23:08:24.725 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-09-27T23:08:24.726 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-09-27T23:08:24.726 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-09-27T23:08:24.727 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-09-27T23:08:24.750 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-09-27T23:08:24.798 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-27T23:08:24.825 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-27T23:08:24.842 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-27T23:08:24.842 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 7} 2023-09-27T23:08:24.864 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-27T23:08:24.865 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 7} 2023-09-27T23:08:24.888 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.4 2023-09-27T23:08:24.888 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:08:24.908 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.4 2023-09-27T23:08:24.908 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:08:24.943 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-09-27T23:08:24.959 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-09-27T23:08:24.976 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-09-27T23:08:24.993 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-09-27T23:08:25.030 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:08:25.123 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:08:25.175 INFO:teuthology.orchestra.console.smithi061:Power off 2023-09-27T23:08:25.175 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-27T23:08:25.199 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-09-27T23:08:25.199 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:25.212 INFO:teuthology.orchestra.console.smithi191:Power off 2023-09-27T23:08:25.212 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-27T23:08:25.219 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-27T23:08:25.232 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-09-27T23:08:25.232 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:25.252 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-27T23:08:29.222 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:29.253 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:29.331 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-27T23:08:29.361 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-27T23:08:33.334 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:33.362 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:33.443 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-27T23:08:33.470 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-27T23:08:37.446 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:37.471 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:37.554 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-27T23:08:37.579 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-27T23:08:37.656 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-09-27T23:08:37.680 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-09-27T23:08:37.756 INFO:teuthology.orchestra.console.smithi061:Power on 2023-09-27T23:08:37.757 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-27T23:08:37.778 DEBUG:teuthology.orchestra.console.smithi061:power on output: Chassis Power Control: Up/On 2023-09-27T23:08:37.779 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:37.785 INFO:teuthology.orchestra.console.smithi191:Power on 2023-09-27T23:08:37.785 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-27T23:08:37.799 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-27T23:08:37.805 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-09-27T23:08:37.805 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:37.824 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-27T23:08:41.804 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:41.825 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:41.913 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-27T23:08:41.931 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-27T23:08:42.014 INFO:teuthology.orchestra.console.smithi061:Power on completed 2023-09-27T23:08:42.114 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-09-27T23:08:42.115 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:08:45.936 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:08:46.044 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-27T23:08:46.144 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-09-27T23:08:46.245 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-09-27T23:08:46.245 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:08:57.189 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:09:01.310 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:09:12.250 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:09:16.371 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:09:27.319 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:09:31.430 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:09:42.386 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:09:46.498 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:09:57.446 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:10:01.559 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:10:12.510 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:10:16.619 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:10:27.576 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:10:31.679 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:10:42.642 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:10:46.758 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:10:57.707 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:11:01.827 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:11:12.777 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:11:16.888 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:11:27.842 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-27T23:11:27.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:11:31.958 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-27T23:11:32.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:11:46.298 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-27T23:11:50.394 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-27T23:11:52.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:11:55.354 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-27T23:11:56.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:11:59.454 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-27T23:12:01.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:12:04.414 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-27T23:12:05.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:12:08.538 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-27T23:12:10.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:12:13.502 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-27T23:12:14.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:12:17.594 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-27T23:12:19.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:12:22.586 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-27T23:12:23.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:12:28.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:13:23.639 WARNING:teuthology.provision.fog.smithi191:timed out 2023-09-27T23:13:28.604 WARNING:teuthology.provision.fog.smithi061:timed out 2023-09-27T23:13:29.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:13:29.975 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-27T23:13:29.976 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-27T23:13:30.255 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-09-27T23:13:30.255 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-09-27T23:13:30.271 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-09-27T23:13:30.271 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-09-27T23:13:30.327 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-09-27T23:13:30.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-09-27T23:13:30.445 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-09-27T23:13:30.470 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-09-27T23:13:30.535 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-09-27T23:13:30.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-09-27T23:13:30.663 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-09-27T23:13:30.717 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-09-27T23:13:30.717 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.4 (Ootpa)" 2023-09-27T23:13:30.717 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-09-27T23:13:30.717 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-09-27T23:13:30.717 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.4" 2023-09-27T23:13:30.717 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-09-27T23:13:30.717 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-27T23:13:30.718 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-27T23:13:30.719 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-27T23:13:30.719 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-27T23:13:30.720 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-09-27T23:13:30.721 DEBUG:teuthology.parallel:result is None 2023-09-27T23:13:34.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:13:34.922 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-27T23:13:34.922 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-27T23:13:35.185 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-09-27T23:13:35.185 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-09-27T23:13:35.201 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061 2023-09-27T23:13:35.201 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061 /etc/hosts 2023-09-27T23:13:35.257 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-09-27T23:13:35.257 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-09-27T23:13:35.372 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061/smithi061/g' /etc/hosts 2023-09-27T23:13:35.399 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-09-27T23:13:35.466 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061/smithi061/g' /etc/hostname 2023-09-27T23:13:35.531 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-09-27T23:13:35.595 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-09-27T23:13:35.650 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-09-27T23:13:35.650 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)" 2023-09-27T23:13:35.650 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-09-27T23:13:35.650 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-09-27T23:13:35.650 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4" 2023-09-27T23:13:35.650 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-27T23:13:35.651 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-27T23:13:35.652 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-09-27T23:13:35.652 DEBUG:teuthology.parallel:result is None 2023-09-27T23:13:35.795 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-09-27T23:13:35.795 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-27T23:13:35.821 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-09-27T23:13:35.821 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-27T23:13:35.847 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-09-27T23:13:35.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-09-27T23:13:35.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:13:35.912 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-09-27T23:13:35.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-09-27T23:13:35.976 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-09-27T23:13:36.030 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-09-27T23:13:36.030 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-09-27T23:13:36.084 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-09-27T23:13:36.084 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-27T23:13:36.085 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-09-27T23:13:36.086 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-27T23:13:36.086 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-27T23:13:36.086 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-27T23:13:36.086 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-27T23:13:36.086 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-09-27T23:13:36.130 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-09-27T23:13:36.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-27T23:13:36.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-27T23:13:36.196 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-09-27T23:13:36.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-27T23:13:36.263 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-09-27T23:13:36.319 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-09-27T23:13:36.319 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-09-27T23:13:36.375 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-09-27T23:13:36.375 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.4 (Ootpa)" 2023-09-27T23:13:36.375 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-09-27T23:13:36.375 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-09-27T23:13:36.375 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.4" 2023-09-27T23:13:36.375 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-09-27T23:13:36.375 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-27T23:13:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-27T23:13:36.377 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-09-27T23:13:36.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:13:36.494 INFO:teuthology.dispatcher.supervisor:Running job 7403466 2023-09-27T23:13:36.494 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403466 --name yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403466/orig.config.yaml 2023-09-27T23:13:36.497 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403466 2023-09-27T23:13:36.497 INFO:teuthology.dispatcher.supervisor:Job PID: 3855551 2023-09-27T23:13:36.497 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-27T23:15:36.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:17:36.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:19:36.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:21:37.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:23:37.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:25:37.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:27:37.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:29:37.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-27T23:29:37.718 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-27T23:29:37.909 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-27T23:29:37.909 INFO:teuthology.nuke:Checking targets against current locks 2023-09-27T23:29:37.970 DEBUG:teuthology.nuke:shortname: smithi061 2023-09-27T23:29:37.971 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-27T23:29:38.012 DEBUG:teuthology.nuke:shortname: smithi191 2023-09-27T23:29:38.013 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-27T23:29:38.014 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403466', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:08:23.818810', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHxM/7KySXMqL2OO43OtY9PLNMjpsmY0pN4mPqcXmFJId2c4g8jKokHCizeZJ9K3GgrKqqdojwwDM5cTnNLk5U='} 2023-09-27T23:29:38.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403466', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:08:23.816840', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOrR8/m2SnEPp6F13UvHDeO8YfY3flSEMcGje+n0xcMw8JLoWcFM7qewnZLCgY5r6KwnBJGTSwM8HUOpOc8q9W4='} 2023-09-27T23:29:38.093 INFO:teuthology.orchestra.console.smithi061:Power off 2023-09-27T23:29:38.094 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-27T23:29:38.132 INFO:teuthology.orchestra.console.smithi191:Power off 2023-09-27T23:29:38.132 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-27T23:29:38.143 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-09-27T23:29:38.143 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:29:38.169 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-27T23:29:38.174 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-09-27T23:29:38.174 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-27T23:29:38.209 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-27T23:29:38.271 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-09-27T23:29:38.310 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-09-27T23:29:38.428 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-09-27T23:29:38.467 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com