2023-08-03T11:10:51.995 INFO:root:teuthology version: 0.0.1.dev176+g250cac1 2023-08-03T11:10:51.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:10:52.142 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b7e424f70>, signals=[15]) 2023-08-03T11:10:52.143 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-08-03T11:10:52.143 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-08-03T11:10:52.144 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-03T11:10:52.167 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-08-03T11:10:52.168 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-08-03T11:10:52.168 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-03T11:10:52.170 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-08-03T11:10:52.191 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-08-03T11:10:52.253 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-03T11:10:52.257 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-03T11:10:52.301 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_centos_8.stream (ID 3) 2023-08-03T11:10:52.301 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 3} 2023-08-03T11:10:52.310 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_8.stream (ID 3) 2023-08-03T11:10:52.310 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 3} 2023-08-03T11:10:52.348 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.stream 2023-08-03T11:10:52.348 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:10:52.355 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 8.stream 2023-08-03T11:10:52.356 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:10:52.400 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-08-03T11:10:52.403 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-08-03T11:10:52.434 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-08-03T11:10:52.438 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-08-03T11:10:52.480 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:10:52.491 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:10:52.583 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-03T11:10:52.584 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T11:10:52.600 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-03T11:10:52.601 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T11:10:52.611 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-03T11:10:52.611 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:10:52.624 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-03T11:10:52.625 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:10:52.635 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-03T11:10:52.647 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-03T11:10:56.640 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:10:56.649 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:10:56.752 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-03T11:10:56.762 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-03T11:11:00.756 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:00.764 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:00.866 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-03T11:11:00.873 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T11:11:00.967 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-03T11:11:00.974 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-03T11:11:01.068 INFO:teuthology.orchestra.console.smithi193:Power on 2023-08-03T11:11:01.068 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-03T11:11:01.076 INFO:teuthology.orchestra.console.smithi022:Power on 2023-08-03T11:11:01.077 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-03T11:11:01.088 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2023-08-03T11:11:01.089 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:01.100 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-08-03T11:11:01.101 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:01.112 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-03T11:11:01.121 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T11:11:05.116 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:05.124 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:05.226 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-03T11:11:05.233 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T11:11:09.229 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:09.237 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:11:09.339 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-03T11:11:09.440 INFO:teuthology.orchestra.console.smithi193:Power on completed 2023-08-03T11:11:09.445 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-03T11:11:09.542 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-08-03T11:11:09.542 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:11:09.547 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-08-03T11:11:09.648 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-08-03T11:11:09.648 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:11:24.620 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:11:24.709 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:11:39.704 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:11:39.773 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:11:54.791 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:11:54.837 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:12:09.869 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:12:09.898 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:12:24.960 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:12:24.961 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:12:40.036 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:12:40.038 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:12:55.116 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:12:55.117 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:13:10.192 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:13:10.194 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:13:25.260 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:13:25.262 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:13:40.328 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T11:13:40.330 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-03T11:13:40.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:13:40.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:13:58.896 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-03T11:13:58.897 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T11:14:04.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:14:04.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:14:07.984 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-03T11:14:07.985 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T11:14:13.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:14:13.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:14:17.040 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-03T11:14:17.041 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T11:14:23.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:14:23.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:14:26.100 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-03T11:14:32.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:14:35.184 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-03T11:14:41.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:15:23.088 WARNING:teuthology.provision.fog.smithi022:timed out 2023-08-03T11:15:29.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:15:29.299 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-03T11:15:29.300 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-03T11:15:29.562 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-08-03T11:15:29.562 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-08-03T11:15:29.583 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-08-03T11:15:29.584 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-08-03T11:15:29.644 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-03T11:15:29.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-03T11:15:29.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-08-03T11:15:29.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-08-03T11:15:29.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-08-03T11:15:29.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-03T11:15:29.985 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-03T11:15:30.045 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-08-03T11:15:30.045 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2023-08-03T11:15:30.045 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-08-03T11:15:30.046 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-08-03T11:15:30.046 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2023-08-03T11:15:30.046 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-03T11:15:30.046 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T11:15:30.046 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-03T11:15:30.046 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T11:15:30.046 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-08-03T11:15:30.047 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T11:15:30.047 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T11:15:30.047 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T11:15:30.048 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-08-03T11:15:30.049 DEBUG:teuthology.parallel:result is None 2023-08-03T11:15:41.200 WARNING:teuthology.provision.fog.smithi193:timed out 2023-08-03T11:15:47.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:15:47.410 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-03T11:15:47.410 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-03T11:15:47.671 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-08-03T11:15:47.672 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-08-03T11:15:47.692 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-08-03T11:15:47.693 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-08-03T11:15:47.752 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-08-03T11:15:47.752 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-03T11:15:47.860 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-08-03T11:15:47.890 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-08-03T11:15:47.960 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-08-03T11:15:48.028 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-03T11:15:48.095 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-03T11:15:48.154 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-08-03T11:15:48.154 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-08-03T11:15:48.155 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-08-03T11:15:48.155 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-08-03T11:15:48.155 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-08-03T11:15:48.155 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-08-03T11:15:48.155 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T11:15:48.155 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-03T11:15:48.156 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T11:15:48.156 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-08-03T11:15:48.156 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T11:15:48.156 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T11:15:48.156 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T11:15:48.157 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-08-03T11:15:48.157 DEBUG:teuthology.parallel:result is None 2023-08-03T11:15:48.306 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-08-03T11:15:48.306 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-03T11:15:48.446 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-08-03T11:15:48.446 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-03T11:15:48.476 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-08-03T11:15:48.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-03T11:15:48.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:15:48.546 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-08-03T11:15:48.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-03T11:15:48.686 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-08-03T11:15:48.745 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-08-03T11:15:48.746 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-03T11:15:48.806 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-08-03T11:15:48.806 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2023-08-03T11:15:48.806 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-08-03T11:15:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T11:15:48.808 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T11:15:48.808 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T11:15:48.808 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-03T11:15:48.832 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-08-03T11:15:48.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-03T11:15:48.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T11:15:48.896 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-08-03T11:15:48.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-03T11:15:48.962 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-08-03T11:15:49.020 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-08-03T11:15:49.020 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-03T11:15:49.079 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-08-03T11:15:49.079 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-08-03T11:15:49.079 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-08-03T11:15:49.079 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-08-03T11:15:49.080 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-08-03T11:15:49.080 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-08-03T11:15:49.080 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T11:15:49.080 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-03T11:15:49.081 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T11:15:49.081 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-08-03T11:15:49.081 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T11:15:49.081 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T11:15:49.082 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T11:15:49.082 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-03T11:15:49.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:15:49.221 INFO:teuthology.dispatcher.supervisor:Running job 7358682 2023-08-03T11:15:49.222 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_250cac13884ccaca114f617952ff3b9f286ec3e7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358682 --name yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} -- /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358682/orig.config.yaml 2023-08-03T11:15:49.226 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358682 2023-08-03T11:15:49.227 INFO:teuthology.dispatcher.supervisor:Job PID: 6188 2023-08-03T11:15:49.227 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-03T11:17:49.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:19:49.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:21:49.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:23:49.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:25:49.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:27:50.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:29:50.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:31:50.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:33:50.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:35:50.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:37:51.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:39:51.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:41:51.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:43:51.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:45:51.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T11:45:51.726 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-03T11:45:51.830 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-03T11:45:51.830 INFO:teuthology.nuke:Checking targets against current locks 2023-08-03T11:45:51.874 DEBUG:teuthology.nuke:shortname: smithi022 2023-08-03T11:45:51.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-03T11:45:51.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-03 11:10:51.161684', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaj6MOk2Lfm+njGRwZK7DYMk1iQ35xQx8EBrcdBvqRIO+0ZpPyCKDRBFQeuoaVgnRXMlmnz22PeOMKYx9PXJHFTNcWp2XJxnBCjYUD31/lNNUB85U94eNuWVEsYRYNJjA6Ftfvqp/Rp82Kk7YhGiOd1HYa4Knb8Eu3IxLqnWREBzITt+53sHcKk9NfHPlPPi8xSHah8WFWiImd1d1jPdwj9Y0RwyyUCkOv4FgW3AYV7m5YS8WQVyjGaoapewEmi3k2G/j2Z7C/c9nnS5fgBdTbJv7oLRX5gDhjB5gLqLrvs3nFszxGKjQjt9Fh0y8aLy6cg5RpZoUpOGEbX3rDFoozt973uwpa4y0J2xsjy/WWb+CE67FffqQ9Yx3/CgcAPvBgWkJIy6+iyA/+kK9JFGOqoLvAJAhtNjYeQxuEhjhO8/AyydbAP7kD1A296uOgB3zAs6NyZI0vT870dxR/We8dSD1IgW4kpUAA4NgCCVVS5bVudpOJoGqsId1IkwGuho8='} 2023-08-03T11:45:51.904 DEBUG:teuthology.nuke:shortname: smithi193 2023-08-03T11:45:51.905 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-03T11:45:51.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-03 11:10:51.163392', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVrMFUZB/viQHPCZM/WswkoECb31qASCOtAO6V26FYWz8YMIc1uv5A6TW2mdTGVjtoo+cWy2mLtpKV0dfdkXGYkgZdipQNBC9M17IEf3gnk66SJ1+mv4wRH26r+c6Z8wcM9+mN5tvX8xjoibHYeL6e/Tm/Qkb/rjJWpgdbXj7wOa4tvpPOf407A6+13l3mM4ztT4RUbi/J3MhE2HNxPpRS2n3orbiDgZ8PvJDgBzsXlmq2zV3ifHb/t0rrUbTjzt1IIFpcQdpf+NgiW+MLwa3cY8G1J0CyrwxWMIlo1er1R6lGJ7GeabTA0m3FC1qFPjZSE6W43rPyHaeXOxoAU1FZ6Nx1lPlCR3KQWGvQXmc6Qap3D9ntaI7uaIxFC4tmZUXZmtpE5rFuum7g0VUP1XvyuiUSHWPUIwbt4ZE32A4HVNMBTopFd+XDFQ4SfOcYzVbJwvz0eTmIL80TK74sp8teRxmM2ZR4vLNPoInn8oSXjNdg7+c8xGyHeSG9lH92VcM='} 2023-08-03T11:45:51.956 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-03T11:45:51.958 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T11:45:51.980 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-03T11:45:51.981 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:45:51.997 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-03T11:45:51.998 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T11:45:52.007 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T11:45:52.019 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-03T11:45:52.019 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T11:45:52.043 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-03T11:45:52.109 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-03T11:45:52.144 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-03T11:45:52.259 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-08-03T11:45:52.292 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com