2023-11-16T11:33:24.532 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T11:33:24.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:33:24.662 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f15cecddee0>, signals=[15]) 2023-11-16T11:33:24.664 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-11-16T11:33:24.664 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T11:33:24.664 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-11-16T11:33:24.690 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-11-16T11:33:24.691 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T11:33:24.691 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-11-16T11:33:24.692 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-11-16T11:33:24.715 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-11-16T11:33:24.756 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T11:33:24.783 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T11:33:24.805 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T11:33:24.805 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 3} 2023-11-16T11:33:24.830 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T11:33:24.830 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 3} 2023-11-16T11:33:24.854 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2023-11-16T11:33:24.854 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:33:24.880 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2023-11-16T11:33:24.880 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:33:25.032 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T11:33:25.067 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-11-16T11:33:25.077 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T11:33:25.109 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-11-16T11:33:25.123 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:33:25.159 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:33:25.399 INFO:teuthology.orchestra.console.smithi116:Power off 2023-11-16T11:33:25.400 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T11:33:25.411 INFO:teuthology.orchestra.console.smithi133:Power off 2023-11-16T11:33:25.412 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T11:33:25.422 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-11-16T11:33:25.423 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:25.432 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-11-16T11:33:25.433 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:25.443 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-11-16T11:33:25.453 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-16T11:33:29.447 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:29.454 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:29.555 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-11-16T11:33:29.562 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-16T11:33:33.557 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:33.563 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:33.666 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-11-16T11:33:33.672 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-16T11:33:33.772 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-11-16T11:33:33.873 INFO:teuthology.orchestra.console.smithi133:Power on 2023-11-16T11:33:33.874 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T11:33:33.895 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-11-16T11:33:33.895 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:33.914 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-16T11:33:37.671 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:37.778 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-11-16T11:33:37.879 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-11-16T11:33:37.915 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:37.980 INFO:teuthology.orchestra.console.smithi116:Power on 2023-11-16T11:33:37.980 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T11:33:38.000 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-11-16T11:33:38.001 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:38.020 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-11-16T11:33:38.024 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-16T11:33:42.025 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:57.194 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T11:33:57.297 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-11-16T11:33:57.309 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-16T11:33:57.398 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-11-16T11:33:57.410 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-11-16T11:33:57.499 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-11-16T11:33:57.500 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:33:57.511 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-11-16T11:33:57.580 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:34:14.602 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:34:15.501 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:34:29.948 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:34:31.022 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:34:45.252 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:34:46.519 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:35:00.726 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:35:02.092 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:35:16.215 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:35:17.732 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:35:32.471 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:35:35.027 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:35:49.886 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:35:51.458 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:36:09.333 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:36:09.401 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:36:25.975 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:36:26.096 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:36:42.270 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:36:42.867 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:36:57.586 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:36:58.769 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:37:12.855 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:37:14.657 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:37:28.086 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:37:29.916 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:37:43.330 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:37:45.137 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:37:59.718 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:38:00.500 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:38:15.126 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:38:15.695 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:38:30.350 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:38:30.881 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:38:45.646 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:38:46.105 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:39:00.854 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:39:01.285 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:39:16.046 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:39:16.448 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-11-16T11:39:16.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:39:19.706 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:39:25.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:39:28.762 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:39:31.237 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:39:34.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:39:37.822 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:39:43.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:39:46.367 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:39:46.906 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:39:52.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:39:55.966 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:40:01.490 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:40:01.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:40:05.018 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:40:11.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:40:16.602 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:40:17.114 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:40:23.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:40:26.170 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:40:31.714 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:40:32.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:40:35.230 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-16T11:40:41.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:40:42.492 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T11:40:42.493 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T11:40:46.812 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:41:01.897 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-16T11:41:01.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:41:05.054 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-16T11:41:08.063 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-11-16T11:41:08.064 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-11-16T11:41:08.087 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-11-16T11:41:08.088 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-11-16T11:41:08.149 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-11-16T11:41:08.150 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-11-16T11:41:08.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-11-16T11:41:08.302 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-11-16T11:41:08.372 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-11-16T11:41:08.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-11-16T11:41:08.509 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-11-16T11:41:08.567 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T11:41:08.568 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-11-16T11:41:08.569 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T11:41:08.569 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T11:41:08.569 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T11:41:08.569 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-11-16T11:41:08.570 DEBUG:teuthology.parallel:result is None 2023-11-16T11:41:11.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:41:14.490 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-16T11:41:20.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:41:23.550 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-16T11:41:29.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:41:32.634 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-16T11:41:38.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:41:46.267 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-16T11:41:52.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:41:55.322 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-16T11:42:01.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:43:01.386 WARNING:teuthology.provision.fog.smithi133:timed out 2023-11-16T11:43:07.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:43:07.674 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T11:43:07.675 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T11:43:07.926 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-11-16T11:43:07.926 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-11-16T11:43:07.986 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-11-16T11:43:07.987 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-11-16T11:43:08.046 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-11-16T11:43:08.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-11-16T11:43:08.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-11-16T11:43:08.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-11-16T11:43:08.234 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-11-16T11:43:08.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-11-16T11:43:08.369 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-11-16T11:43:08.427 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-11-16T11:43:08.427 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2023-11-16T11:43:08.427 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T11:43:08.428 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T11:43:08.429 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-11-16T11:43:08.429 DEBUG:teuthology.parallel:result is None 2023-11-16T11:43:08.591 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-11-16T11:43:08.592 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T11:43:08.629 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-11-16T11:43:08.630 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T11:43:08.655 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-11-16T11:43:08.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-16T11:43:08.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:43:08.725 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-11-16T11:43:08.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-16T11:43:08.862 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-11-16T11:43:08.923 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-11-16T11:43:08.923 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T11:43:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-11-16T11:43:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T11:43:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-11-16T11:43:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T11:43:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T11:43:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T11:43:08.984 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-11-16T11:43:09.012 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-11-16T11:43:09.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-16T11:43:09.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T11:43:09.077 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-11-16T11:43:09.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-16T11:43:09.144 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-11-16T11:43:09.202 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-11-16T11:43:09.203 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-11-16T11:43:09.261 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-11-16T11:43:09.261 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2023-11-16T11:43:09.261 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-11-16T11:43:09.262 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-11-16T11:43:09.262 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2023-11-16T11:43:09.262 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-11-16T11:43:09.263 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T11:43:09.263 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-11-16T11:43:09.263 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T11:43:09.263 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-11-16T11:43:09.263 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T11:43:09.264 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T11:43:09.264 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T11:43:09.265 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-11-16T11:43:09.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:43:09.375 INFO:teuthology.dispatcher.supervisor:Running job 7460545 2023-11-16T11:43:09.375 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-11-16_11:32:14-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460545 --name adking-2023-11-16_11:32:14-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi --description orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} -- /home/teuthworker/archive/adking-2023-11-16_11:32:14-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460545/orig.config.yaml 2023-11-16T11:43:09.378 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-11-16_11:32:14-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460545 2023-11-16T11:43:09.378 INFO:teuthology.dispatcher.supervisor:Job PID: 825121 2023-11-16T11:43:09.378 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-16T11:45:09.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:47:09.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:49:09.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:51:09.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:53:10.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:55:10.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:57:10.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T11:59:10.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T12:01:10.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T12:03:13.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T12:05:13.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T12:05:13.702 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-16T12:05:13.802 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-16T12:05:13.802 INFO:teuthology.nuke:Checking targets against current locks 2023-11-16T12:05:13.845 DEBUG:teuthology.nuke:shortname: smithi116 2023-11-16T12:05:13.845 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T12:05:13.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-16_11:32:14-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460545', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 11:33:23.762766', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRDUDrCo0C3F/5XeTjxyWebBabOpNNrimfrdy82QK+lkfCEjZT71eVdgB1WluYRT3AAB8EXAIk96bbPHVnHvAk='} 2023-11-16T12:05:13.868 DEBUG:teuthology.nuke:shortname: smithi133 2023-11-16T12:05:13.869 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T12:05:13.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-16_11:32:14-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460545', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 11:33:23.761590', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLe9kOyGpCkxmn9yY8+6cN74WGBu8H9+4cnWumwmWS507j5PfgUCHRIVEcji8umATyQHFuonBfT+5ZUyjmp5KWA='} 2023-11-16T12:05:13.908 INFO:teuthology.orchestra.console.smithi116:Power off 2023-11-16T12:05:13.909 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T12:05:13.928 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-11-16T12:05:13.928 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T12:05:13.944 INFO:teuthology.orchestra.console.smithi133:Power off 2023-11-16T12:05:13.944 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T12:05:13.952 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-11-16T12:05:13.964 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-11-16T12:05:13.964 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T12:05:13.987 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-16T12:05:14.053 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-11-16T12:05:14.088 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-11-16T12:05:14.201 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-11-16T12:05:14.236 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com