2023-10-01T09:54:47.473 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-01T09:54:47.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T09:54:47.609 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f98679acf70>, signals=[15]) 2023-10-01T09:54:47.609 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2023-10-01T09:54:47.610 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T09:54:47.610 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-01T09:54:47.626 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-10-01T09:54:47.627 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T09:54:47.627 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-10-01T09:54:47.628 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"} 2023-10-01T09:54:47.651 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-10-01T09:54:47.701 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-01T09:54:47.720 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-01T09:54:47.751 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_8.stream (ID 3) 2023-10-01T09:54:47.751 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 3} 2023-10-01T09:54:47.755 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_8.stream (ID 3) 2023-10-01T09:54:47.755 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 3} 2023-10-01T09:54:47.795 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 8.stream 2023-10-01T09:54:47.795 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:54:47.805 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 8.stream 2023-10-01T09:54:47.805 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:54:47.843 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T09:54:47.847 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T09:54:47.878 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1} 2023-10-01T09:54:47.882 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-10-01T09:54:47.926 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:54:47.935 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:54:48.011 INFO:teuthology.orchestra.console.smithi097:Power off 2023-10-01T09:54:48.011 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T09:54:48.023 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-01T09:54:48.023 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T09:54:48.031 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-10-01T09:54:48.032 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:48.042 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-01T09:54:48.042 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:48.053 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-01T09:54:48.065 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-01T09:54:48.155 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-10-01T09:54:48.165 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-01T09:54:48.256 INFO:teuthology.orchestra.console.smithi097:Power on 2023-10-01T09:54:48.256 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T09:54:48.266 INFO:teuthology.orchestra.console.smithi094:Power on 2023-10-01T09:54:48.267 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T09:54:48.279 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2023-10-01T09:54:48.279 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:48.288 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2023-10-01T09:54:48.288 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:48.299 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-01T09:54:48.309 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-01T09:54:52.302 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:52.310 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:52.411 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-01T09:54:52.419 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-01T09:54:56.419 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:56.425 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:54:56.527 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-10-01T09:54:56.533 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-01T09:54:56.628 INFO:teuthology.orchestra.console.smithi097:Power on completed 2023-10-01T09:54:56.635 INFO:teuthology.orchestra.console.smithi094:Power on completed 2023-10-01T09:54:56.729 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-10-01T09:54:56.729 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:54:56.735 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2023-10-01T09:54:56.735 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:55:11.798 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:55:11.799 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:55:26.874 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:55:26.875 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:55:41.942 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:55:41.944 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:55:57.014 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:55:57.016 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:56:12.086 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:56:12.087 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:56:27.157 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:56:27.158 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:56:42.222 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:56:42.223 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:56:57.300 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:56:57.302 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:57:12.382 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:57:12.383 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:57:27.457 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:57:27.458 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-01T09:57:27.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:57:30.586 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-01T09:57:36.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:57:39.642 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-01T09:57:42.526 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-01T09:57:42.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:57:45.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:57:45.662 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-01T09:57:48.698 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-01T09:57:51.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:57:54.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:57:54.746 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-01T09:57:57.754 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-01T09:58:00.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:03.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:03.802 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-01T09:58:06.810 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-01T09:58:09.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:12.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:12.862 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-01T09:58:15.866 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-01T09:58:18.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:21.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:21.950 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-01T09:58:24.926 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-01T09:58:27.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:30.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:58:31.002 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-01T09:58:37.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:59:30.982 WARNING:teuthology.provision.fog.smithi097:timed out 2023-10-01T09:59:36.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:59:37.008 WARNING:teuthology.provision.fog.smithi094:timed out 2023-10-01T09:59:37.235 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T09:59:37.235 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T09:59:37.504 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-10-01T09:59:37.504 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-10-01T09:59:37.523 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-10-01T09:59:37.523 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2023-10-01T09:59:37.582 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-10-01T09:59:37.582 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-10-01T09:59:37.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2023-10-01T09:59:37.710 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-10-01T09:59:37.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2023-10-01T09:59:37.847 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-10-01T09:59:37.914 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-10-01T09:59:37.973 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-10-01T09:59:37.973 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8" 2023-10-01T09:59:37.973 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-10-01T09:59:37.973 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-10-01T09:59:37.973 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8" 2023-10-01T09:59:37.973 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-10-01T09:59:37.974 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T09:59:37.974 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-10-01T09:59:37.974 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T09:59:37.974 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-10-01T09:59:37.974 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T09:59:37.974 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T09:59:37.974 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T09:59:37.975 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-10-01T09:59:37.976 DEBUG:teuthology.parallel:result is None 2023-10-01T09:59:43.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:59:43.240 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T09:59:43.240 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T09:59:43.496 INFO:teuthology.provision.fog.smithi094:Node is ready 2023-10-01T09:59:43.496 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2023-10-01T09:59:43.515 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2023-10-01T09:59:43.515 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2023-10-01T09:59:43.574 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2023-10-01T09:59:43.575 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-01T09:59:43.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2023-10-01T09:59:43.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2023-10-01T09:59:43.776 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2023-10-01T09:59:43.844 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-01T09:59:43.910 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-01T09:59:43.968 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T09:59:43.969 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T09:59:43.969 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T09:59:43.969 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2023-10-01T09:59:43.969 DEBUG:teuthology.parallel:result is None 2023-10-01T09:59:44.118 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2023-10-01T09:59:44.118 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T09:59:44.139 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-10-01T09:59:44.139 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T09:59:44.156 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2023-10-01T09:59:44.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-01T09:59:44.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:59:44.221 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-01T09:59:44.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-01T09:59:44.288 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-10-01T09:59:44.346 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-10-01T09:59:44.346 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-01T09:59:44.404 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-01T09:59:44.404 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-10-01T09:59:44.404 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-01T09:59:44.404 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-01T09:59:44.404 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-10-01T09:59:44.404 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-01T09:59:44.404 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T09:59:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-01T09:59:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T09:59:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-01T09:59:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T09:59:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T09:59:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T09:59:44.405 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-01T09:59:44.430 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-10-01T09:59:44.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-10-01T09:59:44.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T09:59:44.498 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-10-01T09:59:44.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-10-01T09:59:44.572 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-10-01T09:59:44.632 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-10-01T09:59:44.632 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-10-01T09:59:44.692 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-10-01T09:59:44.692 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8" 2023-10-01T09:59:44.692 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-10-01T09:59:44.692 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-10-01T09:59:44.692 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T09:59:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T09:59:44.694 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-10-01T09:59:44.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T09:59:44.834 INFO:teuthology.dispatcher.supervisor:Running job 7408002 2023-10-01T09:59:44.835 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7408002 --name teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7408002/orig.config.yaml 2023-10-01T09:59:44.837 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7408002 2023-10-01T09:59:44.837 INFO:teuthology.dispatcher.supervisor:Job PID: 1559074 2023-10-01T09:59:44.838 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-01T10:01:44.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:03:45.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:05:45.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:07:45.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:09:45.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:11:45.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:13:45.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:15:46.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:17:46.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:19:46.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:21:46.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:23:46.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:25:46.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:27:47.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:29:47.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:31:47.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:33:47.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:35:47.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:37:47.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:39:48.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:41:48.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:43:48.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:45:48.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:47:48.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:49:48.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:51:48.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:53:49.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:55:49.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:57:49.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T10:59:49.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:01:49.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:03:49.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:05:50.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:07:50.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:09:50.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:11:50.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:13:50.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:15:50.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T11:15:50.965 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-01T11:15:51.178 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-01T11:15:51.178 INFO:teuthology.nuke:Checking targets against current locks 2023-10-01T11:15:51.233 DEBUG:teuthology.nuke:shortname: smithi094 2023-10-01T11:15:51.233 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T11:15:51.255 DEBUG:teuthology.nuke:shortname: smithi097 2023-10-01T11:15:51.255 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T11:15:51.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7408002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 09:54:46.632052', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN49aLrphQxAtVchfB4FNIIurCiROY7epK/ns9VxBi3bAE9letlJYzy+LbaTOwcAXszQa1NtrwUdMN2iK+st4OY='} 2023-10-01T11:15:51.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7408002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 09:54:46.633037', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeTkWn+ZbO/pbLTdbS6bZ+PeW/RCRb8RsulQMwlILHeXuQLhMsGwyLi2XrgQDSTtpFebOxiLyvmJEgg5Zqx2yQ='} 2023-10-01T11:15:51.308 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-01T11:15:51.308 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T11:15:51.328 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-01T11:15:51.328 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T11:15:51.344 INFO:teuthology.orchestra.console.smithi097:Power off 2023-10-01T11:15:51.344 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T11:15:51.354 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-01T11:15:51.368 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-10-01T11:15:51.368 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T11:15:51.389 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-01T11:15:51.455 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-01T11:15:51.490 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-10-01T11:15:51.617 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com 2023-10-01T11:15:51.639 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com