2023-07-13T01:14:29.218 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-13T01:14:29.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:14:29.221 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:14:29.381 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdc6420e8b0>, signals=[15]) 2023-07-13T01:14:29.382 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-07-13T01:14:29.383 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T01:14:29.383 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-07-13T01:14:29.407 INFO:teuthology.lock.ops:Start node 'smithi202.front.sepia.ceph.com' reimaging 2023-07-13T01:14:29.408 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T01:14:29.408 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-07-13T01:14:29.409 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-07-13T01:14:29.432 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /host {"name": "smithi202"} 2023-07-13T01:14:29.492 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T01:14:29.500 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T01:14:29.533 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T01:14:29.534 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 3} 2023-07-13T01:14:29.543 DEBUG:teuthology.provision.fog.smithi202:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T01:14:29.543 DEBUG:teuthology.provision.fog.smithi202:FOG request: PUT /host/306 {"imageID": 3} 2023-07-13T01:14:29.574 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2023-07-13T01:14:29.575 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:14:29.593 INFO:teuthology.provision.fog.smithi202:Scheduling deploy of centos 8.stream 2023-07-13T01:14:29.593 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:14:29.646 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T01:14:29.649 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T01:14:29.686 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-07-13T01:14:29.690 DEBUG:teuthology.provision.fog.smithi202:FOG request: POST /host/306/task {"taskTypeID": 1} 2023-07-13T01:14:29.740 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:14:29.746 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:14:29.846 INFO:teuthology.orchestra.console:Power off smithi202 2023-07-13T01:14:29.847 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:14:29.864 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-13T01:14:29.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:14:29.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:29.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:33.900 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:33.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:38.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:38.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:38.225 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-07-13T01:14:38.238 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-13T01:14:38.327 INFO:teuthology.orchestra.console:Power on smithi202 2023-07-13T01:14:38.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T01:14:38.340 INFO:teuthology.orchestra.console:Power on smithi152 2023-07-13T01:14:38.341 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T01:14:38.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:38.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:42.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:42.387 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:42.599 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2023-07-13T01:14:42.700 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-07-13T01:14:42.700 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:14:46.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:14:46.761 INFO:teuthology.orchestra.console:Power on for smithi202 completed 2023-07-13T01:14:46.862 INFO:teuthology.provision.fog.smithi202:Waiting for deploy to finish 2023-07-13T01:14:46.862 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:14:57.790 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:15:01.952 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:15:12.892 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:15:17.036 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:15:27.991 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:15:32.120 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:15:43.073 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:15:47.199 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:15:58.171 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:16:02.274 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:16:13.260 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:16:17.364 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:16:28.336 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:16:32.424 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:16:43.412 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:16:47.488 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:16:58.476 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:17:02.544 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:17:13.538 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:17:17.596 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-13T01:17:17.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:20.720 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-13T01:17:26.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:28.588 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-13T01:17:28.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:29.776 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-13T01:17:31.696 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-13T01:17:35.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:37.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:38.836 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-13T01:17:40.756 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-13T01:17:44.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:46.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:47.920 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-13T01:17:49.840 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-13T01:17:53.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:55.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:17:56.980 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-13T01:17:58.896 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-13T01:18:02.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:04.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:06.064 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-13T01:18:07.952 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-13T01:18:12.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:13.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:15.124 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-13T01:18:17.012 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-13T01:18:21.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:23.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:26.096 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-13T01:18:32.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:52.861 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T01:18:52.862 DEBUG:teuthology.orchestra.run.smithi202:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T01:19:18.598 INFO:teuthology.provision.fog.smithi202:Node is ready 2023-07-13T01:19:18.599 DEBUG:teuthology.orchestra.run.smithi202:> hostname 2023-07-13T01:19:18.624 INFO:teuthology.orchestra.run.smithi202.stdout:smithi202.front.sepia.ceph.com 2023-07-13T01:19:18.624 DEBUG:teuthology.orchestra.run.smithi202:> grep smithi202.front.sepia.ceph.com /etc/hosts 2023-07-13T01:19:18.685 INFO:teuthology.orchestra.run.smithi202.stdout:172.21.15.202 smithi202.front.sepia.ceph.com smithi202 2023-07-13T01:19:18.686 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202 2023-07-13T01:19:18.810 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hosts 2023-07-13T01:19:18.846 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/172.21.15.202/172.21.15.202/g' /etc/hosts 2023-07-13T01:19:18.920 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hostname 2023-07-13T01:19:18.994 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202 2023-07-13T01:19:19.067 DEBUG:teuthology.orchestra.run.smithi202:> cat /etc/os-release 2023-07-13T01:19:19.129 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="CentOS Stream" 2023-07-13T01:19:19.129 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8" 2023-07-13T01:19:19.129 INFO:teuthology.orchestra.run.smithi202.stdout:ID="centos" 2023-07-13T01:19:19.129 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:19:19.130 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:19:19.131 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:19:19.131 INFO:teuthology.provision.fog.smithi202:Deploy complete! 2023-07-13T01:19:19.133 DEBUG:teuthology.parallel:result is None 2023-07-13T01:19:32.113 WARNING:teuthology.provision.fog.smithi152:timed out 2023-07-13T01:19:38.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:19:38.371 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T01:19:38.371 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T01:19:38.653 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-07-13T01:19:38.653 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-07-13T01:19:38.673 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-07-13T01:19:38.674 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-07-13T01:19:38.734 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-07-13T01:19:38.734 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-13T01:19:38.833 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-07-13T01:19:38.863 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-07-13T01:19:38.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-07-13T01:19:39.003 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-13T01:19:39.072 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-07-13T01:19:39.130 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-07-13T01:19:39.131 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-07-13T01:19:39.131 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-07-13T01:19:39.131 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:19:39.131 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-07-13T01:19:39.131 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:19:39.132 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:19:39.132 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-07-13T01:19:39.132 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:19:39.132 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:19:39.132 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:19:39.132 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:19:39.132 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:19:39.133 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-07-13T01:19:39.133 DEBUG:teuthology.parallel:result is None 2023-07-13T01:19:39.318 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-07-13T01:19:39.319 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T01:19:39.350 INFO:teuthology.lock.ops:Checking smithi202.front.sepia.ceph.com 2023-07-13T01:19:39.351 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T01:19:39.377 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-07-13T01:19:39.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-07-13T01:19:39.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:19:39.445 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-07-13T01:19:39.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-07-13T01:19:39.515 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-07-13T01:19:39.573 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-07-13T01:19:39.573 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-07-13T01:19:39.631 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-07-13T01:19:39.632 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-07-13T01:19:39.632 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-07-13T01:19:39.632 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:19:39.632 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-07-13T01:19:39.632 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:19:39.633 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:19:39.633 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-07-13T01:19:39.633 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:19:39.633 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:19:39.633 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:19:39.633 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:19:39.633 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:19:39.634 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-07-13T01:19:39.676 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: set os type and version on server 2023-07-13T01:19:39.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com' 2023-07-13T01:19:39.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:19:39.744 DEBUG:teuthology.orchestra.run.smithi202:> true 2023-07-13T01:19:39.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi202.front.sepia.ceph.com' 2023-07-13T01:19:39.889 DEBUG:teuthology.orchestra.run.smithi202:> uname -m 2023-07-13T01:19:39.950 INFO:teuthology.orchestra.run.smithi202.stdout:x86_64 2023-07-13T01:19:39.950 DEBUG:teuthology.orchestra.run.smithi202:> cat /etc/os-release 2023-07-13T01:19:40.011 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="CentOS Stream" 2023-07-13T01:19:40.011 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8" 2023-07-13T01:19:40.011 INFO:teuthology.orchestra.run.smithi202.stdout:ID="centos" 2023-07-13T01:19:40.012 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:19:40.012 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8" 2023-07-13T01:19:40.012 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:19:40.012 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:19:40.012 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31" 2023-07-13T01:19:40.013 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:19:40.013 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:19:40.013 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:19:40.013 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:19:40.013 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:19:40.014 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-07-13T01:19:40.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:19:40.044 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:19:40.136 INFO:teuthology.dispatcher.supervisor:Running job 7335584 2023-07-13T01:19:40.137 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335584 --name gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi --description orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335584/orig.config.yaml 2023-07-13T01:19:40.140 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335584 2023-07-13T01:19:40.141 INFO:teuthology.dispatcher.supervisor:Job PID: 29720 2023-07-13T01:19:40.141 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T01:21:40.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:21:40.241 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:23:40.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:23:40.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:25:40.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:25:40.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:27:40.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:27:40.790 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:29:40.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:29:40.983 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:31:41.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:31:41.170 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:33:41.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:33:41.354 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:35:41.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:35:41.528 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:37:41.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:37:41.706 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:39:41.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:39:41.880 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:41:42.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:41:42.065 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:43:42.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:43:42.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:45:42.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:45:42.419 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:47:42.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:47:42.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:47:42.703 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T01:47:42.853 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T01:47:42.854 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T01:47:42.907 DEBUG:teuthology.nuke:shortname: smithi152 2023-07-13T01:47:42.908 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T01:47:42.922 DEBUG:teuthology.nuke:shortname: smithi202 2023-07-13T01:47:42.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T01:47:42.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:14:28.378824', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEgSrRyeLipvP7IirIsqm0zT3jO1sbzHejpBskK9+oH9FyH1XaUQ42fRnJqHTUYDU5lASfTmoQ4S2XmNZvbS4SCotdkRMWsv8jDi2zK/uaChNje7A3hVOg3Q6fRjK5KwrxS4wJr2rEpsDW/MRQrdWn+7ho3041PyH5cE6q4uNrOHPG35jHoDxx/yD+xbVm6vKM0ACTTu3ToHYIEVnSD+WFeeNB6cK52dydmIRrOOfabS0RWc6ZCl91lGgksC7lggX7jZ4QKm+xGKl2r9Y7LA9X9qorxpfs5GlaiEjk7tICeO4GJD05WU+07ku93G0Eqm72ocGW/3yK8uZDO8yFOTVtVOdrdgZ38tATHO3F+TJOHIB4EwXiD/xoK0tt+k2vsJvR08EDG4rzCVWFbhsQ7HINcQvgQUTPgvc4iy1+ko9UgR7Xtogu51S5T0zsNmfvo5E734zj8XptULLBt9oaLz9/pc5yanlPBHbjheQlGdou1at25Tm7cXL+ctJtWYXo5T8='} 2023-07-13T01:47:42.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi202.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:14:28.380768', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2dZKPeBX2uPxMW8T7V3zz8JciMN60m/oaJ+bRSszWa5Ftjf3687rfaX3ZhDg7eGw5DGmFSHZ3L6pnPgs75HIXviSdCqoCrPqqv8nQeX9tWTa2Jcfvs34iIJ/ARGwlho28odUDBrP/5McuaY/rR3I2yHXTaTJESezQUJMOoihCXVjqaA0t0bVywos7Azptkq5RT6M07vCkbYWFdN3+voBh0lBxNvSkOFR7f9OIAoHOSN9glEOviCoXzQGwROQqPUTmtrQBHTA4N08nqzkgOewyJIICOmdPDy8PCQcGvo98xtaMpO+UmLCOYsZ3bld41JeRTZKSFEDheQ4335Q+a2r4dTEZGGe1O7Otdua6dRNbLUIzl6Um/vfhOcgNQ3lGguFxlvuUzqE7217p7Qx2ck57Nhzicphnw07A35bo5M42aM5pq+3ziB0i3vqsspoMTdR/OjuBQPWHaf5n3sKvJRg/DOw04m2HfSrTcY+sElaJkL+ebLukys0XnTxgJEYrPhs='} 2023-07-13T01:47:42.985 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-13T01:47:42.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:47:43.000 INFO:teuthology.orchestra.console:Power off smithi202 2023-07-13T01:47:43.001 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:47:43.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:47:43.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:47:43.136 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-13T01:47:43.148 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-07-13T01:47:43.293 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2023-07-13T01:47:43.301 INFO:teuthology.lock.ops:unlocked: smithi202.front.sepia.ceph.com