2023-11-10T04:02:42.045 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-10T04:02:42.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:02:42.191 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff28ccce670>, signals=[15]) 2023-11-10T04:02:42.192 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2023-11-10T04:02:42.193 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2023-11-10T04:02:42.193 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-11-10T04:02:42.220 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-11-10T04:02:42.220 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-11-10T04:02:42.221 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-11-10T04:02:42.222 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"} 2023-11-10T04:02:42.245 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-11-10T04:02:42.299 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-11-10T04:02:42.322 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-11-10T04:02:42.347 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.4 (ID 7) 2023-11-10T04:02:42.347 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 7} 2023-11-10T04:02:42.367 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.4 (ID 7) 2023-11-10T04:02:42.367 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 7} 2023-11-10T04:02:42.399 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.4 2023-11-10T04:02:42.400 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:02:42.409 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.4 2023-11-10T04:02:42.409 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:02:42.491 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"} 2023-11-10T04:02:42.495 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-11-10T04:02:42.532 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1} 2023-11-10T04:02:42.536 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-11-10T04:02:42.598 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:02:42.601 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:02:42.713 INFO:teuthology.orchestra.console.smithi194:Power off 2023-11-10T04:02:42.714 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T04:02:42.725 INFO:teuthology.orchestra.console.smithi067:Power off 2023-11-10T04:02:42.726 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T04:02:42.735 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-11-10T04:02:42.736 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:42.748 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-11-10T04:02:42.749 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:42.757 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-11-10T04:02:42.771 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-10T04:02:46.762 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:46.771 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:46.872 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-11-10T04:02:46.881 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-10T04:02:50.876 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:50.884 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:50.986 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-10T04:02:50.994 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-10T04:02:51.088 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-11-10T04:02:51.189 INFO:teuthology.orchestra.console.smithi194:Power on 2023-11-10T04:02:51.190 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-10T04:02:51.214 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-11-10T04:02:51.215 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:51.236 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-10T04:02:54.998 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:55.107 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-10T04:02:55.208 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-11-10T04:02:55.237 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:55.310 INFO:teuthology.orchestra.console.smithi067:Power on 2023-11-10T04:02:55.310 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-10T04:02:55.331 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2023-11-10T04:02:55.332 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:55.346 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-10T04:02:55.353 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-10T04:02:59.351 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:59.359 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:02:59.461 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-11-10T04:02:59.467 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-10T04:02:59.563 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-11-10T04:02:59.568 INFO:teuthology.orchestra.console.smithi067:Power on completed 2023-11-10T04:02:59.664 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-11-10T04:02:59.665 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:02:59.669 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2023-11-10T04:02:59.669 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:03:14.754 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:03:14.755 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:03:29.834 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:03:29.835 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:03:44.920 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:03:44.921 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:04:00.006 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:04:00.008 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:04:15.094 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:04:15.095 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:04:30.166 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:04:30.168 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:04:45.243 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:04:45.247 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:05:00.334 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:05:00.335 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:05:15.430 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:05:15.432 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:05:30.510 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:05:30.512 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:05:45.587 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-10T04:05:45.589 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-10T04:05:45.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:05:45.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:05:48.698 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-10T04:05:48.730 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-10T04:05:54.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:05:54.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:05:57.754 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-10T04:05:57.786 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-10T04:06:03.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:03.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:06.814 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-10T04:06:06.842 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-10T04:06:12.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:12.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:15.898 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-10T04:06:15.899 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-10T04:06:21.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:21.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:24.986 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-10T04:06:24.987 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-10T04:06:30.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:30.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:34.046 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-10T04:06:34.078 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-10T04:06:40.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:40.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:06:43.130 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-10T04:06:49.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:07:28.008 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-10T04:07:28.010 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-10T04:07:40.082 WARNING:teuthology.provision.fog.smithi194:timed out 2023-11-10T04:07:46.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:07:46.338 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-10T04:07:46.338 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-10T04:07:46.615 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-11-10T04:07:46.616 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-11-10T04:07:46.670 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-11-10T04:07:46.671 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-11-10T04:07:46.725 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-11-10T04:07:46.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-11-10T04:07:46.844 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-11-10T04:07:46.869 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-11-10T04:07:46.933 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-11-10T04:07:46.997 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-11-10T04:07:47.060 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-11-10T04:07:47.115 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T04:07:47.115 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.4 (Ootpa)" 2023-11-10T04:07:47.115 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-11-10T04:07:47.115 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-11-10T04:07:47.116 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.4" 2023-11-10T04:07:47.116 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-11-10T04:07:47.116 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-10T04:07:47.116 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-11-10T04:07:47.116 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-10T04:07:47.117 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T04:07:47.117 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T04:07:47.117 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T04:07:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-10T04:07:47.117 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T04:07:47.118 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-10T04:07:47.118 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T04:07:47.118 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-10T04:07:47.119 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-11-10T04:07:47.120 DEBUG:teuthology.parallel:result is None 2023-11-10T04:07:48.522 INFO:teuthology.provision.fog.smithi067:Node is ready 2023-11-10T04:07:48.523 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2023-11-10T04:07:48.543 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2023-11-10T04:07:48.544 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2023-11-10T04:07:48.604 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2023-11-10T04:07:48.604 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-11-10T04:07:48.785 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2023-11-10T04:07:48.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2023-11-10T04:07:48.877 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2023-11-10T04:07:48.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-11-10T04:07:49.006 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-11-10T04:07:49.060 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T04:07:49.061 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-11-10T04:07:49.061 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-11-10T04:07:49.061 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-11-10T04:07:49.061 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-11-10T04:07:49.061 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-11-10T04:07:49.062 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-10T04:07:49.062 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-11-10T04:07:49.062 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-10T04:07:49.062 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T04:07:49.063 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T04:07:49.063 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T04:07:49.063 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-10T04:07:49.063 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T04:07:49.063 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-10T04:07:49.064 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T04:07:49.064 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-10T04:07:49.064 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2023-11-10T04:07:49.065 DEBUG:teuthology.parallel:result is None 2023-11-10T04:07:49.213 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2023-11-10T04:07:49.214 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-10T04:07:49.241 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-11-10T04:07:49.241 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-10T04:07:49.267 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2023-11-10T04:07:49.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-10T04:07:49.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:07:49.338 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-11-10T04:07:49.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-10T04:07:49.357 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-11-10T04:07:49.411 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-11-10T04:07:49.412 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-11-10T04:07:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T04:07:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-11-10T04:07:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-11-10T04:07:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-11-10T04:07:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-11-10T04:07:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-11-10T04:07:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-10T04:07:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-11-10T04:07:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-10T04:07:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T04:07:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T04:07:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T04:07:49.468 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-10T04:07:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T04:07:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-10T04:07:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T04:07:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-10T04:07:49.469 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-11-10T04:07:49.491 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-11-10T04:07:49.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-10T04:07:49.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T04:07:49.562 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-11-10T04:07:49.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-10T04:07:49.586 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-11-10T04:07:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-11-10T04:07:49.643 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-11-10T04:07:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T04:07:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.4 (Ootpa)" 2023-11-10T04:07:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-11-10T04:07:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-11-10T04:07:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.4" 2023-11-10T04:07:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-11-10T04:07:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-10T04:07:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-11-10T04:07:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-10T04:07:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T04:07:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T04:07:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T04:07:49.702 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-10T04:07:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T04:07:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-10T04:07:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T04:07:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-10T04:07:49.704 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-11-10T04:07:49.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:07:49.817 INFO:teuthology.dispatcher.supervisor:Running job 7453546 2023-11-10T04:07:49.818 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453546 --name yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/insights} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453546/orig.config.yaml 2023-11-10T04:07:49.821 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453546 2023-11-10T04:07:49.822 INFO:teuthology.dispatcher.supervisor:Job PID: 3313204 2023-11-10T04:07:49.822 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-10T04:09:49.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:11:50.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:13:50.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:15:50.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:17:50.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:19:50.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:21:50.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:23:51.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:25:51.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T04:25:51.342 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-10T04:25:51.430 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-10T04:25:51.430 INFO:teuthology.nuke:Checking targets against current locks 2023-11-10T04:25:51.479 DEBUG:teuthology.nuke:shortname: smithi067 2023-11-10T04:25:51.480 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-10T04:25:51.505 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-10 04:02:41.239298', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHR9Dyvl17Nu8k4hiu4XM5TmC3z1O4L/uPSQXrqNA6HNYT2xwLheWHqStTTcGz3WZmJ3x9ux/TTMVNlOW1B9wA='} 2023-11-10T04:25:51.509 DEBUG:teuthology.nuke:shortname: smithi194 2023-11-10T04:25:51.510 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-10T04:25:51.534 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-10 04:02:41.240747', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK+8GrglEiuZ0FFRmmuX0Q/9WplKCEo31lrfJ++a7wMzB02h2qth8gzV3FfmMy8JCUoez1Tqw470q2xANjkO6ow='} 2023-11-10T04:25:51.569 INFO:teuthology.orchestra.console.smithi067:Power off 2023-11-10T04:25:51.570 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T04:25:51.594 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-11-10T04:25:51.594 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:25:51.612 INFO:teuthology.orchestra.console.smithi194:Power off 2023-11-10T04:25:51.613 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T04:25:51.621 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-10T04:25:51.639 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-11-10T04:25:51.639 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T04:25:51.661 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-10T04:25:51.724 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-11-10T04:25:51.763 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-11-10T04:25:51.875 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2023-11-10T04:25:51.907 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com