2023-11-15T04:27:17.441 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T04:27:17.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:27:17.600 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa7171ab670>, signals=[15]) 2023-11-15T04:27:17.601 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-11-15T04:27:17.602 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T04:27:17.602 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-11-15T04:27:17.621 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-11-15T04:27:17.622 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T04:27:17.622 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-11-15T04:27:17.623 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-11-15T04:27:17.646 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-11-15T04:27:17.697 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-15T04:27:17.722 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-15T04:27:17.747 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2023-11-15T04:27:17.748 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 3} 2023-11-15T04:27:17.758 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2023-11-15T04:27:17.758 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 3} 2023-11-15T04:27:17.796 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2023-11-15T04:27:17.796 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:27:17.803 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2023-11-15T04:27:17.803 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:27:17.858 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T04:27:17.869 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T04:27:17.896 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-11-15T04:27:17.902 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-11-15T04:27:17.947 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:27:17.954 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:27:18.062 INFO:teuthology.orchestra.console.smithi099:Power off 2023-11-15T04:27:18.063 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T04:27:18.080 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-15T04:27:18.080 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T04:27:18.093 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-11-15T04:27:18.094 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:18.105 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-15T04:27:18.106 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:18.118 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-11-15T04:27:18.130 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-15T04:27:22.122 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:22.131 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:22.232 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-11-15T04:27:22.240 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-15T04:27:26.234 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:26.241 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:26.343 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-11-15T04:27:26.351 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-15T04:27:26.444 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-11-15T04:27:26.545 INFO:teuthology.orchestra.console.smithi099:Power on 2023-11-15T04:27:26.546 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T04:27:26.570 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-11-15T04:27:26.571 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:26.593 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-11-15T04:27:30.355 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:30.464 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-15T04:27:30.565 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-15T04:27:30.595 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:30.666 INFO:teuthology.orchestra.console.smithi161:Power on 2023-11-15T04:27:30.667 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T04:27:30.689 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-11-15T04:27:30.689 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:30.705 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-11-15T04:27:30.712 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-15T04:27:34.710 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:34.718 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T04:27:34.828 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-15T04:27:34.929 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-11-15T04:27:34.933 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-11-15T04:27:35.030 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-11-15T04:27:35.030 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:27:35.034 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-11-15T04:27:35.136 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-11-15T04:27:35.136 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:27:50.108 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:27:50.201 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:28:05.194 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:28:05.262 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:28:20.274 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:28:20.320 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:28:35.370 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:28:35.381 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:28:50.445 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:28:50.450 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:29:05.530 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:29:05.532 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:29:20.621 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:29:20.623 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:29:35.705 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:29:35.707 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:29:50.794 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:29:50.796 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:30:05.884 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:30:05.885 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:30:20.982 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-11-15T04:30:20.984 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-11-15T04:30:21.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:21.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:24.126 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-15T04:30:24.127 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-15T04:30:30.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:30.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:33.210 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-15T04:30:33.211 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-15T04:30:39.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:39.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:42.266 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-15T04:30:42.298 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-15T04:30:48.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:48.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:51.354 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-15T04:30:51.355 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-15T04:30:57.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:30:57.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:31:00.446 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-15T04:31:00.447 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-15T04:31:06.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:31:06.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:31:09.530 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-15T04:31:09.531 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-15T04:31:15.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:31:15.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:31:47.426 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T04:31:47.427 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T04:32:12.983 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-11-15T04:32:12.984 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-11-15T04:32:13.008 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-11-15T04:32:13.009 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-11-15T04:32:13.069 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-11-15T04:32:13.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-11-15T04:32:13.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-11-15T04:32:13.231 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-11-15T04:32:13.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-11-15T04:32:13.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-11-15T04:32:13.437 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-11-15T04:32:13.495 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-11-15T04:32:13.495 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-11-15T04:32:13.495 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-11-15T04:32:13.496 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-11-15T04:32:13.496 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-11-15T04:32:13.496 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-11-15T04:32:13.496 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T04:32:13.496 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-11-15T04:32:13.497 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T04:32:13.497 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-11-15T04:32:13.497 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T04:32:13.497 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T04:32:13.497 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T04:32:13.498 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-11-15T04:32:13.500 DEBUG:teuthology.parallel:result is None 2023-11-15T04:32:15.538 WARNING:teuthology.provision.fog.smithi161:timed out 2023-11-15T04:32:21.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:32:21.789 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T04:32:21.789 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T04:32:22.051 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-11-15T04:32:22.051 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-11-15T04:32:22.071 INFO:teuthology.orchestra.run.smithi161.stdout:smithi193 2023-11-15T04:32:22.071 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi193 /etc/hosts 2023-11-15T04:32:22.131 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-11-15T04:32:22.131 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-11-15T04:32:22.257 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi193/smithi161/g' /etc/hosts 2023-11-15T04:32:22.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.193/172.21.15.161/g' /etc/hosts 2023-11-15T04:32:22.353 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi193/smithi161/g' /etc/hostname 2023-11-15T04:32:22.421 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-11-15T04:32:22.488 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-11-15T04:32:22.547 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-11-15T04:32:22.547 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-11-15T04:32:22.548 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-11-15T04:32:22.548 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-11-15T04:32:22.548 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-11-15T04:32:22.549 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-11-15T04:32:22.549 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T04:32:22.549 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-11-15T04:32:22.549 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T04:32:22.549 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-11-15T04:32:22.550 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T04:32:22.550 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T04:32:22.550 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T04:32:22.550 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-11-15T04:32:22.551 DEBUG:teuthology.parallel:result is None 2023-11-15T04:32:22.703 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-11-15T04:32:22.703 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T04:32:22.729 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-11-15T04:32:22.729 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T04:32:22.756 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-11-15T04:32:22.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-15T04:32:22.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:32:22.825 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-11-15T04:32:22.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-15T04:32:22.896 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-11-15T04:32:22.957 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-11-15T04:32:22.957 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-11-15T04:32:23.018 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-11-15T04:32:23.018 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-11-15T04:32:23.018 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-11-15T04:32:23.019 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-11-15T04:32:23.019 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-11-15T04:32:23.019 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-11-15T04:32:23.019 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T04:32:23.020 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-11-15T04:32:23.020 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T04:32:23.020 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-11-15T04:32:23.020 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T04:32:23.021 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T04:32:23.021 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T04:32:23.021 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-11-15T04:32:23.054 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-11-15T04:32:23.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-15T04:32:23.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T04:32:23.123 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-11-15T04:32:23.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-15T04:32:23.197 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-11-15T04:32:23.255 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-11-15T04:32:23.256 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-11-15T04:32:23.314 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-11-15T04:32:23.314 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-11-15T04:32:23.314 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-11-15T04:32:23.314 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-11-15T04:32:23.315 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-11-15T04:32:23.315 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-11-15T04:32:23.315 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T04:32:23.315 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-11-15T04:32:23.316 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T04:32:23.316 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-11-15T04:32:23.316 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T04:32:23.316 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T04:32:23.316 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T04:32:23.317 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-11-15T04:32:23.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:32:23.439 INFO:teuthology.dispatcher.supervisor:Running job 7458397 2023-11-15T04:32:23.439 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458397 --name yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} -- /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458397/orig.config.yaml 2023-11-15T04:32:23.443 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458397 2023-11-15T04:32:23.443 INFO:teuthology.dispatcher.supervisor:Job PID: 3031005 2023-11-15T04:32:23.444 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-15T04:34:23.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:36:23.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:38:23.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:40:24.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:42:24.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:44:24.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:46:24.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:48:24.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:50:24.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:52:25.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:54:25.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:56:25.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T04:58:25.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:00:25.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:02:25.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:04:26.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:06:26.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:08:26.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:10:26.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T05:10:26.669 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-15T05:10:26.832 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-15T05:10:26.833 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T05:10:26.885 DEBUG:teuthology.nuke:shortname: smithi099 2023-11-15T05:10:26.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T05:10:26.910 DEBUG:teuthology.nuke:shortname: smithi161 2023-11-15T05:10:26.911 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T05:10:26.915 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 04:27:16.575919', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHF5Sd2yXbNqvfWJ/hX4GuVmmjHgYtLC85y3zbq2BRxIpPPQTSmr+1F1Mk7FOdB3Eew9fOxa6Z6XBXTBZ/7CR+Q='} 2023-11-15T05:10:26.939 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 04:27:16.577552', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPX01DzeZUiMjVh8IcJor+hgTqgxPA9m4/1OyKoeZuNG5Ps6Sn3pMwpFXmWUBIOyxu4GRmpPXcRvYm+S7B4fbc='} 2023-11-15T05:10:26.967 INFO:teuthology.orchestra.console.smithi099:Power off 2023-11-15T05:10:26.968 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T05:10:26.999 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-11-15T05:10:27.000 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T05:10:27.029 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-15T05:10:27.029 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T05:10:27.063 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-11-15T05:10:27.083 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-15T05:10:27.083 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T05:10:27.124 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-15T05:10:27.164 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-11-15T05:10:27.226 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-15T05:10:27.326 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-11-15T05:10:27.377 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com