2023-11-02T09:08:24.790 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-02T09:08:24.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:08:24.938 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa1aede2f70>, signals=[15]) 2023-11-02T09:08:24.940 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-11-02T09:08:24.941 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-11-02T09:08:24.941 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-11-02T09:08:24.963 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-11-02T09:08:24.964 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-11-02T09:08:24.964 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-11-02T09:08:24.966 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-11-02T09:08:24.988 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-11-02T09:08:25.060 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-02T09:08:25.064 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-02T09:08:25.103 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_8.stream (ID 3) 2023-11-02T09:08:25.104 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 3} 2023-11-02T09:08:25.107 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_8.stream (ID 3) 2023-11-02T09:08:25.107 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 3} 2023-11-02T09:08:25.148 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream 2023-11-02T09:08:25.149 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:08:25.152 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream 2023-11-02T09:08:25.152 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:08:25.257 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-11-02T09:08:25.261 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-11-02T09:08:25.295 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-11-02T09:08:25.298 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-11-02T09:08:25.349 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:08:25.353 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:08:25.463 INFO:teuthology.orchestra.console.smithi123:Power off 2023-11-02T09:08:25.464 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T09:08:25.481 INFO:teuthology.orchestra.console.smithi157:Power off 2023-11-02T09:08:25.481 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T09:08:25.497 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-11-02T09:08:25.498 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:08:25.507 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-11-02T09:08:25.508 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:08:25.523 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-11-02T09:08:25.538 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-02T09:08:25.625 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-11-02T09:08:25.639 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-11-02T09:08:25.727 INFO:teuthology.orchestra.console.smithi123:Power on 2023-11-02T09:08:25.727 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-02T09:08:25.741 INFO:teuthology.orchestra.console.smithi157:Power on 2023-11-02T09:08:25.741 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-02T09:08:25.752 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-11-02T09:08:25.752 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:08:25.771 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-11-02T09:08:25.772 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:08:25.785 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-11-02T09:08:25.799 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-02T09:08:29.786 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:08:29.801 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:08:29.894 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-11-02T09:08:29.911 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-11-02T09:08:30.011 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-11-02T09:08:30.112 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-11-02T09:08:30.113 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:08:33.899 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:08:34.008 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-11-02T09:08:34.109 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-11-02T09:08:34.210 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-11-02T09:08:34.210 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:08:45.218 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:08:49.302 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:09:00.318 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:09:04.407 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:09:15.428 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:09:19.494 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:09:30.530 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:09:34.608 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:09:45.642 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:09:49.695 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:10:00.742 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:10:04.864 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:10:15.842 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:10:19.961 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:10:30.946 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:10:35.074 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:10:46.046 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:10:50.198 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:11:01.189 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:11:05.347 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-11-02T09:11:05.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:08.506 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-02T09:11:14.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:16.305 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:11:17.566 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-02T09:11:23.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:26.654 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-02T09:11:31.410 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-02T09:11:31.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:32.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:34.558 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:11:35.742 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-02T09:11:40.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:41.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:43.642 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:11:44.830 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-02T09:11:49.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:50.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:52.698 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:11:53.882 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-02T09:11:58.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:11:59.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:12:01.790 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:12:07.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:12:10.875 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:12:16.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:12:19.964 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:12:25.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:12:29.055 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:12:35.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:12:38.138 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:12:44.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:12:47.226 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:12:53.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:12:59.894 WARNING:teuthology.provision.fog.smithi123:timed out 2023-11-02T09:13:05.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:13:06.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-02T09:13:06.093 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-02T09:13:06.368 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-11-02T09:13:06.368 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-11-02T09:13:06.430 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-11-02T09:13:06.444 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-11-02T09:13:06.494 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-11-02T09:13:06.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-11-02T09:13:06.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-11-02T09:13:06.641 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-11-02T09:13:06.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-11-02T09:13:06.780 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-11-02T09:13:06.848 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-11-02T09:13:06.906 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-11-02T09:13:06.907 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-11-02T09:13:06.907 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-11-02T09:13:06.907 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-11-02T09:13:06.907 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-11-02T09:13:06.907 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-11-02T09:13:06.908 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-02T09:13:06.908 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-11-02T09:13:06.908 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-02T09:13:06.908 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-11-02T09:13:06.908 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T09:13:06.909 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-02T09:13:06.909 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T09:13:06.910 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-11-02T09:13:06.911 DEBUG:teuthology.parallel:result is None 2023-11-02T09:13:11.546 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:13:17.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:13:20.638 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-02T09:13:26.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:13:29.932 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-02T09:13:29.932 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-02T09:13:54.728 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-11-02T09:13:54.728 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-11-02T09:13:54.754 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-11-02T09:13:54.754 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-11-02T09:13:54.815 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-11-02T09:13:54.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-11-02T09:13:54.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-11-02T09:13:54.979 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-11-02T09:13:55.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-11-02T09:13:55.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-11-02T09:13:55.187 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-11-02T09:13:55.246 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2023-11-02T09:13:55.246 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2023-11-02T09:13:55.247 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2023-11-02T09:13:55.247 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2023-11-02T09:13:55.247 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2023-11-02T09:13:55.247 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-11-02T09:13:55.247 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-02T09:13:55.248 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-11-02T09:13:55.248 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-02T09:13:55.248 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2023-11-02T09:13:55.248 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T09:13:55.248 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-02T09:13:55.249 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T09:13:55.249 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-11-02T09:13:55.250 DEBUG:teuthology.parallel:result is None 2023-11-02T09:13:55.410 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-11-02T09:13:55.410 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-02T09:13:55.436 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-11-02T09:13:55.437 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-02T09:13:55.453 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-11-02T09:13:55.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-11-02T09:13:55.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:13:55.524 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-11-02T09:13:55.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-11-02T09:13:55.662 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-11-02T09:13:55.720 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-11-02T09:13:55.720 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-11-02T09:13:55.778 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-11-02T09:13:55.779 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-11-02T09:13:55.779 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-11-02T09:13:55.779 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-11-02T09:13:55.779 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-11-02T09:13:55.780 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-11-02T09:13:55.780 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-02T09:13:55.780 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-11-02T09:13:55.780 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-02T09:13:55.781 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-11-02T09:13:55.781 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T09:13:55.781 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-02T09:13:55.781 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T09:13:55.782 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-11-02T09:13:55.802 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-11-02T09:13:55.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-11-02T09:13:55.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:13:55.874 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-11-02T09:13:55.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-11-02T09:13:55.949 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-11-02T09:13:56.009 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-11-02T09:13:56.010 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-11-02T09:13:56.069 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2023-11-02T09:13:56.070 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2023-11-02T09:13:56.070 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2023-11-02T09:13:56.070 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2023-11-02T09:13:56.071 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2023-11-02T09:13:56.071 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-11-02T09:13:56.071 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-02T09:13:56.071 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-11-02T09:13:56.072 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-02T09:13:56.072 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2023-11-02T09:13:56.072 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T09:13:56.072 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-02T09:13:56.072 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T09:13:56.073 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-11-02T09:13:56.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:13:56.198 INFO:teuthology.dispatcher.supervisor:Running job 7444096 2023-11-02T09:13:56.198 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444096 --name teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444096/orig.config.yaml 2023-11-02T09:13:56.203 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444096 2023-11-02T09:13:56.203 INFO:teuthology.dispatcher.supervisor:Job PID: 3042040 2023-11-02T09:13:56.204 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-02T09:15:56.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:17:56.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:19:56.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:21:56.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:23:57.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:25:57.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:27:57.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:29:57.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:29:57.639 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-02T09:29:57.791 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-02T09:29:57.792 INFO:teuthology.nuke:Checking targets against current locks 2023-11-02T09:29:57.868 DEBUG:teuthology.nuke:shortname: smithi123 2023-11-02T09:29:57.869 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-02T09:29:57.914 DEBUG:teuthology.nuke:shortname: smithi157 2023-11-02T09:29:57.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-02T09:29:57.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444096', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-02 09:08:23.928183', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO/T7iNJBrAC5EztsMeyhIOG9XyCwb7jTawo53ts7DgIcHWSs0dXzr2hSWAgmW2WroxnBFyuUgvEQEaInokePto='} 2023-11-02T09:29:57.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444096', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-02 09:08:23.930025', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMok5NqeP3X2zvgmJ2dIMdCgO0apoplDegPDiMjePMhuaVKIU2IiEUNdsn7akRSH5tX4MO3iVudl+E1xhiJif3U='} 2023-11-02T09:29:58.021 INFO:teuthology.orchestra.console.smithi123:Power off 2023-11-02T09:29:58.022 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T09:29:58.059 INFO:teuthology.orchestra.console.smithi157:Power off 2023-11-02T09:29:58.059 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T09:29:58.072 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-11-02T09:29:58.072 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:29:58.104 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-11-02T09:29:58.106 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-11-02T09:29:58.106 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:29:58.138 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-02T09:29:58.206 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-11-02T09:29:58.239 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-11-02T09:29:58.388 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-11-02T09:29:58.421 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com