2023-08-28T17:57:39.560 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-28T17:57:39.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T17:57:39.685 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc2c5d04ee0>, signals=[15]) 2023-08-28T17:57:39.686 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-08-28T17:57:39.686 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T17:57:39.686 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-08-28T17:57:39.709 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-08-28T17:57:39.709 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T17:57:39.709 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-28T17:57:39.710 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"} 2023-08-28T17:57:39.734 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-08-28T17:57:40.056 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-28T17:57:40.110 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-28T17:57:40.479 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_8.stream (ID 3) 2023-08-28T17:57:40.480 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 3} 2023-08-28T17:57:40.570 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3) 2023-08-28T17:57:40.571 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 3} 2023-08-28T17:57:41.340 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream 2023-08-28T17:57:41.341 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:57:41.346 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream 2023-08-28T17:57:41.346 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:57:45.526 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T17:57:45.689 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-08-28T17:57:45.951 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T17:57:46.076 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1} 2023-08-28T17:57:46.142 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:57:46.562 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:57:50.196 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-28T17:57:50.196 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T17:57:50.215 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-28T17:57:50.216 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:50.235 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-28T17:57:50.336 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-28T17:57:50.436 INFO:teuthology.orchestra.console.smithi112:Power on 2023-08-28T17:57:50.437 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T17:57:50.456 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-08-28T17:57:50.456 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:50.476 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-28T17:57:50.781 INFO:teuthology.orchestra.console.smithi084:Power off 2023-08-28T17:57:50.781 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T17:57:50.799 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-08-28T17:57:50.800 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:50.819 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-08-28T17:57:50.920 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-08-28T17:57:51.020 INFO:teuthology.orchestra.console.smithi084:Power on 2023-08-28T17:57:51.021 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T17:57:51.040 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2023-08-28T17:57:51.040 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:51.059 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-08-28T17:57:54.480 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:54.587 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-28T17:57:54.688 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-08-28T17:57:54.789 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-08-28T17:57:54.789 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:57:55.060 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T17:57:55.167 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-08-28T17:57:55.268 INFO:teuthology.orchestra.console.smithi084:Power on completed 2023-08-28T17:57:55.369 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-08-28T17:57:55.369 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:58:10.292 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:58:10.802 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:58:29.286 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:58:29.408 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:58:47.184 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:58:48.018 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:59:04.443 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:59:05.270 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:59:20.761 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:59:20.987 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:59:38.282 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T17:59:38.362 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:59:56.738 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T17:59:56.888 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:00:15.354 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:00:15.423 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:00:33.624 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:00:34.293 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:00:50.247 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:00:50.542 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:01:06.591 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:01:06.704 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:01:23.369 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:01:23.384 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:01:39.387 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:01:39.418 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:01:55.431 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:01:55.432 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:02:11.415 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:02:11.416 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:02:27.163 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:02:27.212 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:02:42.800 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:02:42.880 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:02:58.263 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:02:58.270 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:03:13.587 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:03:13.605 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:03:28.827 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:03:28.828 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:03:44.075 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:03:44.081 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:03:59.309 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:03:59.327 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:04:14.530 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:04:14.548 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:04:29.743 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:04:29.745 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:04:44.943 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:04:44.944 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:05:00.155 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:05:00.156 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:05:15.327 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:05:15.328 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:05:30.507 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:05:30.508 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:05:45.689 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:05:45.691 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:06:00.843 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:06:00.844 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-08-28T18:06:00.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:04.027 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:06:10.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:13.083 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:06:15.975 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:06:19.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:22.139 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:06:28.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:31.087 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-28T18:06:31.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:31.195 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:06:34.239 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-28T18:06:37.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:40.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:40.251 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:06:43.323 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-28T18:06:46.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:49.307 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:06:49.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:52.380 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-28T18:06:55.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:06:58.363 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:06:58.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:01.435 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-28T18:07:04.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:07.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:10.463 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:07:10.492 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-28T18:07:16.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:16.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:19.547 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:07:19.553 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-28T18:07:25.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:25.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:28.635 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-08-28T18:07:34.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:07:35.973 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T18:07:35.973 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T18:08:00.946 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-08-28T18:08:00.946 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-08-28T18:08:00.972 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2023-08-28T18:08:00.976 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2023-08-28T18:08:01.033 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-08-28T18:08:01.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-08-28T18:08:01.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2023-08-28T18:08:01.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-08-28T18:08:01.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2023-08-28T18:08:01.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-08-28T18:08:01.401 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-08-28T18:08:01.461 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-08-28T18:08:01.461 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:08:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:08:01.463 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-08-28T18:08:01.463 DEBUG:teuthology.parallel:result is None 2023-08-28T18:08:25.558 WARNING:teuthology.provision.fog.smithi112:timed out 2023-08-28T18:08:31.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:08:31.811 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T18:08:31.811 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T18:08:32.061 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-08-28T18:08:32.061 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-08-28T18:08:32.107 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-08-28T18:08:32.108 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-08-28T18:08:32.185 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-08-28T18:08:32.185 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-28T18:08:32.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-08-28T18:08:32.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-08-28T18:08:32.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-08-28T18:08:32.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-28T18:08:32.562 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-28T18:08:32.623 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-28T18:08:32.623 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8" 2023-08-28T18:08:32.623 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-28T18:08:32.623 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:08:32.623 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8" 2023-08-28T18:08:32.624 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:08:32.624 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:08:32.624 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-28T18:08:32.624 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:08:32.624 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:08:32.624 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:08:32.624 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:08:32.630 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:08:32.631 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-08-28T18:08:32.631 DEBUG:teuthology.parallel:result is None 2023-08-28T18:08:32.983 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-08-28T18:08:32.984 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T18:08:33.006 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-08-28T18:08:33.006 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T18:08:33.046 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-08-28T18:08:33.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-08-28T18:08:33.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:08:33.324 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-08-28T18:08:33.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-08-28T18:08:33.398 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-08-28T18:08:33.501 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-08-28T18:08:33.519 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-08-28T18:08:33.560 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-08-28T18:08:33.560 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:08:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:08:33.562 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-08-28T18:08:33.669 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-08-28T18:08:33.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-28T18:08:33.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T18:08:33.836 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-08-28T18:08:33.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-28T18:08:33.887 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-08-28T18:08:33.959 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-08-28T18:08:33.960 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-28T18:08:34.041 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T18:08:34.042 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-28T18:08:34.052 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T18:08:34.053 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-28T18:08:34.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:08:34.254 INFO:teuthology.dispatcher.supervisor:Running job 7382322 2023-08-28T18:08:34.256 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382322 --name adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} -- /home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382322/orig.config.yaml 2023-08-28T18:08:34.270 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382322 2023-08-28T18:08:34.271 INFO:teuthology.dispatcher.supervisor:Job PID: 144718 2023-08-28T18:08:34.271 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-28T18:10:34.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:12:34.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:14:34.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:16:35.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:18:35.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:20:35.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:22:35.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:24:36.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:26:36.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:28:36.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:30:36.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:32:36.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:34:36.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:36:37.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:38:37.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:40:37.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:42:37.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:44:37.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:46:37.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:48:38.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:50:38.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:52:38.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:54:38.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:56:38.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:58:38.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T18:58:39.010 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-08-28T18:58:39.138 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-28T18:58:39.138 INFO:teuthology.nuke:Checking targets against current locks 2023-08-28T18:58:39.186 DEBUG:teuthology.nuke:shortname: smithi084 2023-08-28T18:58:39.187 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T18:58:39.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382322', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 17:57:38.758056', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsY6NaVf1T+c9jIQbfvbGFZaB1Q6MwWIhPVLbxQaYM4sPQahP3GFU79iUgDxaSufqRdwE4kzJoMPkQxC7l1lG+0o0UUS1eXbNVvEDwivE6H4EdF9u08xBh0xGTOPRjyZVMXXinY7jrclja4l8xOHqpmQIyuFtSYNQVvx24TxBaPP1xLTwC9uunUkXqP0VESCtuWZY7Gvhe9b1k5HvjFaPDrKGrRFcK4DY7HC5WSRug5fDcj/hPcBNLH6VPfZH5GgyJPvOGso0qa1PHhU/x76ao8V19SNqZU+OCSKNG/S4hbEg9DpP+ThEKiohTHQ9ozcS8tlzMAneXLFfvoz0OzUQ4FYp+B4HKdEialLvr7ikqzvjcGZ01lWhe51Lb+NVEl5a67j9V/3N4hAveowOuWSuqtJejXJRvWEeAGKTLNf39glQw04jUuks21s+bad2NJjU/kkpDyUK18BcRQOe0tIHUOH5vGvq/zgno1HmlYvHCxe9C5xffpaPaRoOFef9e8X0='} 2023-08-28T18:58:39.217 DEBUG:teuthology.nuke:shortname: smithi112 2023-08-28T18:58:39.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T18:58:39.236 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-08-28_16:10:32-orch:cephadm-wip-adk4-testing-2023-08-23-1835-reef-distro-default-smithi/7382322', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 17:57:38.760465', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr/uvUPXaPVZ1IXFuENoyCVl4MOMiiP8+Z7n2ypnxccX28gZjWeWXOvuufDwHsfCMfvvpGz8PkoYwZsUQzzczpim8p6j9TTUp64SFseK7MAQdQEht0lfGqWzOsPaBOEYDauaKWs61Cc6kIP2FnWA3XdRF4iHoiCzh7+vDvdCcayeYuqFtjrqIJ0YCdww9LXAcKVoEP3gWr1dFTd/BwlzoOpEMPQzVOnJVJ4cTK5RKcmVUIU2EJwma0LnAyskFw8wKcw5gGiEHf4HM81Cc7/mgAnpvZzOTuo8e/CYbmZ3qjT4nH3tUmjPHCMNim5QiEdSOE1vfU1upRIySoC0/Q4KPVC5870kmdq3TLSfukpI/JAqMvJJKWwYM9mrN5Ud8jExTMypGXO99Mst6cHV8mUHVKSB3AhQphUNmAgweZDiwczvui2/xqgrYCVSobzsgVZ+zMpp5Bxk0xYS9HHVLw+QDLpY4siKcrqGQD1bYA2z4vXfLeVQZ7VYCSfKCovJkc+A8='} 2023-08-28T18:58:39.266 INFO:teuthology.orchestra.console.smithi084:Power off 2023-08-28T18:58:39.266 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T18:58:39.286 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-08-28T18:58:39.286 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T18:58:39.303 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-28T18:58:39.303 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T18:58:39.312 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-08-28T18:58:39.321 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-28T18:58:39.321 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T18:58:39.343 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-28T18:58:39.414 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-08-28T18:58:39.444 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-28T18:58:39.567 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2023-08-28T18:58:39.583 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com