2023-07-13T01:01:02.799 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-13T01:01:02.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:01:02.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:01:02.971 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa4d10dadc0>, signals=[15]) 2023-07-13T01:01:02.973 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-13T01:01:02.973 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T01:01:02.974 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-13T01:01:02.997 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-07-13T01:01:02.998 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T01:01:02.999 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-13T01:01:03.000 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-13T01:01:03.031 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-07-13T01:01:03.091 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T01:01:03.095 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T01:01:03.133 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T01:01:03.134 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 3} 2023-07-13T01:01:03.137 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T01:01:03.138 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 3} 2023-07-13T01:01:03.184 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.stream 2023-07-13T01:01:03.185 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:01:03.188 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream 2023-07-13T01:01:03.188 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:01:03.244 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T01:01:03.248 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T01:01:03.283 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-07-13T01:01:03.292 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-13T01:01:03.334 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:01:03.349 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:01:03.435 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-13T01:01:03.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:01:03.456 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-13T01:01:03.457 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:01:03.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:03.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:07.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:07.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:11.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:11.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:11.830 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-13T01:01:11.931 INFO:teuthology.orchestra.console:Power on smithi026 2023-07-13T01:01:11.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T01:01:11.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:15.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:15.934 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-13T01:01:15.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:16.035 INFO:teuthology.orchestra.console:Power on smithi145 2023-07-13T01:01:16.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T01:01:16.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:20.082 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:20.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:20.306 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-07-13T01:01:20.407 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-13T01:01:20.407 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:01:24.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:01:24.411 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2023-07-13T01:01:24.512 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-07-13T01:01:24.512 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:01:35.497 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:01:39.588 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:01:50.582 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:01:54.648 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:02:05.656 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:02:09.708 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:02:20.732 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:02:24.766 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:02:35.809 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:02:39.836 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:02:50.880 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:02:54.900 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:03:05.955 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:03:09.960 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:03:21.020 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:03:25.018 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:03:36.088 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:03:40.081 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:03:51.164 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-13T01:03:51.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:03:54.288 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-13T01:03:55.138 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:04:00.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:03.344 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-13T01:04:09.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:10.192 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-13T01:04:10.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:12.400 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-13T01:04:13.296 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-13T01:04:18.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:19.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:21.492 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-13T01:04:22.352 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-13T01:04:27.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:28.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:30.576 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-13T01:04:31.408 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-13T01:04:36.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:37.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:40.464 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-13T01:04:46.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:04:49.520 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-13T01:04:55.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:05:36.604 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-13T01:05:42.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:05:42.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T01:05:42.857 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T01:05:43.109 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-13T01:05:43.109 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-13T01:05:43.128 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-13T01:05:43.129 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-13T01:05:43.188 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-13T01:05:43.189 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-13T01:05:43.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-13T01:05:43.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-13T01:05:43.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-13T01:05:43.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-13T01:05:43.547 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-13T01:05:43.605 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-13T01:05:43.605 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-07-13T01:05:43.605 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-13T01:05:43.605 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:05:43.606 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-07-13T01:05:43.606 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:05:43.606 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:05:43.606 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-13T01:05:43.606 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:05:43.606 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:05:43.606 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:05:43.607 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:05:43.607 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:05:43.607 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-13T01:05:43.609 DEBUG:teuthology.parallel:result is None 2023-07-13T01:05:55.538 WARNING:teuthology.provision.fog.smithi145:timed out 2023-07-13T01:06:01.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:06:01.747 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T01:06:01.748 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T01:06:02.056 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-07-13T01:06:02.057 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-07-13T01:06:02.077 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-07-13T01:06:02.078 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-07-13T01:06:02.138 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-07-13T01:06:02.138 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-13T01:06:02.235 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-07-13T01:06:02.265 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-07-13T01:06:02.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-07-13T01:06:02.403 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-13T01:06:02.470 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-13T01:06:02.528 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-07-13T01:06:02.529 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-07-13T01:06:02.529 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-07-13T01:06:02.529 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:06:02.529 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:06:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:06:02.531 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-07-13T01:06:02.531 DEBUG:teuthology.parallel:result is None 2023-07-13T01:06:02.699 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-13T01:06:02.700 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T01:06:02.723 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-07-13T01:06:02.724 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T01:06:02.741 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-13T01:06:02.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-13T01:06:02.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:06:02.816 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-13T01:06:02.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-13T01:06:02.957 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-13T01:06:03.017 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-13T01:06:03.018 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-13T01:06:03.078 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-13T01:06:03.078 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-07-13T01:06:03.078 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-13T01:06:03.078 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:06:03.078 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-07-13T01:06:03.079 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:06:03.079 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:06:03.079 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-13T01:06:03.079 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:06:03.079 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:06:03.079 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:06:03.079 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:06:03.080 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:06:03.080 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-13T01:06:03.107 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-07-13T01:06:03.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-13T01:06:03.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:06:03.177 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-13T01:06:03.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-13T01:06:03.251 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-07-13T01:06:03.309 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-07-13T01:06:03.310 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-13T01:06:03.368 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-07-13T01:06:03.369 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-07-13T01:06:03.369 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-07-13T01:06:03.369 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:06:03.369 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-07-13T01:06:03.369 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:06:03.370 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:06:03.370 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-13T01:06:03.370 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:06:03.370 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:06:03.370 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:06:03.370 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:06:03.371 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:06:03.371 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-13T01:06:03.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:06:03.399 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:06:03.497 INFO:teuthology.dispatcher.supervisor:Running job 7335573 2023-07-13T01:06:03.498 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335573 --name gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} -- /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335573/orig.config.yaml 2023-07-13T01:06:03.501 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335573 2023-07-13T01:06:03.501 INFO:teuthology.dispatcher.supervisor:Job PID: 21489 2023-07-13T01:06:03.502 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T01:08:03.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:08:03.599 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:10:03.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:10:03.775 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:12:03.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:12:03.901 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:14:04.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:14:04.078 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:16:04.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:16:04.307 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:18:04.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:18:04.497 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:20:04.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:20:04.694 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:22:04.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:22:04.869 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:24:05.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:24:05.050 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:26:05.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:26:05.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:28:05.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:28:05.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:30:05.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:30:05.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:32:05.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:32:05.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:34:05.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:34:05.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:36:06.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:36:06.074 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:38:06.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:38:06.251 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:40:06.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:40:06.531 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:42:06.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:42:06.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:44:06.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:44:06.913 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:46:07.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:46:07.090 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:48:07.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:48:07.270 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:50:07.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:50:07.440 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:52:07.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:52:07.614 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:54:07.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:54:07.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:56:07.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:56:07.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:58:08.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:58:08.128 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:00:08.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:00:08.302 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:02:08.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:02:08.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:04:08.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:04:08.653 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:06:08.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:06:08.831 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:08:08.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:08:08.997 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:10:09.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:10:09.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:12:09.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:12:09.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:14:09.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:14:09.581 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:16:09.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:16:09.747 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:16:09.817 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T02:16:10.048 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T02:16:10.049 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T02:16:10.102 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-13T02:16:10.102 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:16:10.129 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:01:01.893229', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsVRSJDssKqTBWvDaVn+YTGRVbj0RcdAtTNyb//8bvCCO0YHHbXNmzYaNgeWS3BPMUwi4sHRF5WPqaN3gopZ6YZjpOVcIAWprXK1I3ILLHFZFmOEjw8O3RjdN+QyGq1V5gz8VSVpsCw8wvSNmDlVwUiWyjGF9TgKpQ4D7gXQY4BT2hhz210knV33mg3YlEEggtBMc1P7PNmaz8t5IBE6gHMv+SdBiJP7I/6w8Ctocwc0u3fx9mWTy47lo1ErBMC54m8ezmecNEUbVQY6rDc9CWkuXQQgaePoClcIMrTqsvdmHqYaeO1AbVBnIyTK8vBPOkO4u7+h0jtlmuQWS8FdUNagyr8eosV4zyePek+954LquAiwEl4Yt8+lmyK1ZCbDO/c3I6PcyXK4xzOY4b8wQAome++hB/g8r2o0njp/rBop4qhNHWS7EQdB/Dq+DbbNuo4FwQkQfPy3uC5ysdKK7U159th74/vF/14AcI+1AtqgWdlOXvrV6qLuNtzYHx83E='} 2023-07-13T02:16:10.132 DEBUG:teuthology.nuke:shortname: smithi145 2023-07-13T02:16:10.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:16:10.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:01:01.891612', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDcvG6ksBCWXsBw++c8hF5sW3HA18yX19o4Im1JNtLSP3nAKiX2qi8nMMFZdZcdEr8UAjObddWa3PxDGCAuyTmKkoszUxfbI0n7EvJrirte5Rr20NfCsw3tchqElzzyg4OHartkNktB+kJDhcX7Q9s06zNOb4++lZZ4ENfWcEX9wridmsJAAXhH3NhPHn45bEaXgTZUslPECepWOsStjhpXFTo6uQ9UzF/scPsTq1t6zimJm76MaRLcr+60eeckQbHO9Xt61AcU1ZQgwnx9jC27YqEiFWNxFBSkQ6hkyDfY09jAIyZK1rvEe4OoioaT519Pan/V3n0CM1RT1wuNtlWAMFx8JPeK506DZkudctFAM/f/X7bn93Fg8gxqJOqAjSBYubPVFGzdNqpsXBz51a0KehiPb7n4HALCi6LY4ew5MZ2cMRTkk6sBQKpKQXmDPjW6+kZvSoPHn0lcn6c2P7D1TlaEydRpZH3SW5dNui70aaQXo++qbG/rRAKS3ozAQM='} 2023-07-13T02:16:10.197 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-13T02:16:10.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:16:10.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:16:10.238 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-13T02:16:10.238 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:16:10.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:16:10.350 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-13T02:16:10.387 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-13T02:16:10.518 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-07-13T02:16:10.582 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com