2023-07-18T13:19:30.341 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-18T13:19:30.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:19:30.343 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:19:30.505 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f833b18b940>, signals=[15]) 2023-07-18T13:19:30.506 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-18T13:19:30.507 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T13:19:30.507 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-18T13:19:30.529 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-07-18T13:19:30.530 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T13:19:30.530 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-07-18T13:19:30.532 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-18T13:19:30.554 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-07-18T13:19:30.612 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-18T13:19:30.622 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-18T13:19:30.655 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_centos_8.stream (ID 3) 2023-07-18T13:19:30.655 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 3} 2023-07-18T13:19:30.666 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3) 2023-07-18T13:19:30.667 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 3} 2023-07-18T13:19:30.703 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 8.stream 2023-07-18T13:19:30.704 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:19:30.710 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2023-07-18T13:19:30.710 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:19:30.748 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T13:19:30.765 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T13:19:30.783 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-18T13:19:30.805 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-07-18T13:19:30.835 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:19:30.879 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:19:30.940 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-18T13:19:30.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T13:19:30.961 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-18T13:19:30.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T13:19:30.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:19:30.985 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:19:31.096 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-18T13:19:31.108 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-18T13:19:31.198 INFO:teuthology.orchestra.console:Power on smithi140 2023-07-18T13:19:31.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T13:19:31.209 INFO:teuthology.orchestra.console:Power on smithi152 2023-07-18T13:19:31.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T13:19:31.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:19:31.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:19:35.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:19:35.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:19:35.466 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2023-07-18T13:19:35.567 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-07-18T13:19:35.568 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:19:39.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:19:39.573 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-07-18T13:19:39.674 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-18T13:19:39.675 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:19:50.632 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:19:54.732 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:20:05.696 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:20:09.793 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:20:20.760 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:20:24.860 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:20:35.820 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:20:39.916 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:20:50.884 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:20:54.980 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:21:05.952 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:21:10.048 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:21:21.029 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:21:25.120 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:21:36.108 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:21:40.192 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:21:51.204 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:21:55.276 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:22:06.280 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:22:10.352 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:22:21.368 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-18T13:22:21.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:24.528 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:22:25.428 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-18T13:22:25.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:28.597 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:22:30.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:33.588 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:22:34.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:37.680 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:22:39.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:42.644 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:22:43.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:46.736 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:22:48.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:51.728 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:22:52.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:22:55.792 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:22:57.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:00.784 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:23:01.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:04.852 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:23:06.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:09.840 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:23:10.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:13.904 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:23:15.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:18.896 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:23:19.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:22.960 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:23:24.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:27.952 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-18T13:23:28.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:32.016 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-18T13:23:33.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:23:38.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:24:34.012 WARNING:teuthology.provision.fog.smithi152:timed out 2023-07-18T13:24:38.024 WARNING:teuthology.provision.fog.smithi140:timed out 2023-07-18T13:24:40.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:24:40.263 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T13:24:40.264 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T13:24:40.521 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-07-18T13:24:40.522 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-07-18T13:24:40.543 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-07-18T13:24:40.544 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-07-18T13:24:40.603 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-07-18T13:24:40.603 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-18T13:24:40.709 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-07-18T13:24:40.739 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-07-18T13:24:40.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-07-18T13:24:40.877 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-18T13:24:40.944 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-07-18T13:24:41.003 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-07-18T13:24:41.003 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-07-18T13:24:41.003 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-07-18T13:24:41.003 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-07-18T13:24:41.003 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-07-18T13:24:41.004 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-07-18T13:24:41.004 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-18T13:24:41.004 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-07-18T13:24:41.004 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-18T13:24:41.004 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-07-18T13:24:41.004 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T13:24:41.005 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T13:24:41.005 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T13:24:41.005 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-07-18T13:24:41.007 DEBUG:teuthology.parallel:result is None 2023-07-18T13:24:44.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:24:44.232 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T13:24:44.232 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T13:24:44.508 INFO:teuthology.provision.fog.smithi140:Node is ready 2023-07-18T13:24:44.508 DEBUG:teuthology.orchestra.run.smithi140:> hostname 2023-07-18T13:24:44.527 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2023-07-18T13:24:44.528 DEBUG:teuthology.orchestra.run.smithi140:> grep smithi140.front.sepia.ceph.com /etc/hosts 2023-07-18T13:24:44.586 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2023-07-18T13:24:44.587 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-07-18T13:24:44.690 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hosts 2023-07-18T13:24:44.719 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/172.21.15.140/172.21.15.140/g' /etc/hosts 2023-07-18T13:24:44.788 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hostname 2023-07-18T13:24:44.855 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-07-18T13:24:44.922 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-07-18T13:24:44.981 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream" 2023-07-18T13:24:44.981 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8" 2023-07-18T13:24:44.981 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos" 2023-07-18T13:24:44.981 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora" 2023-07-18T13:24:44.982 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8" 2023-07-18T13:24:44.982 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-07-18T13:24:44.982 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-18T13:24:44.982 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-07-18T13:24:44.982 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-18T13:24:44.982 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/" 2023-07-18T13:24:44.983 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T13:24:44.983 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T13:24:44.983 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T13:24:44.984 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2023-07-18T13:24:44.985 DEBUG:teuthology.parallel:result is None 2023-07-18T13:24:45.142 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2023-07-18T13:24:45.143 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T13:24:45.171 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-07-18T13:24:45.171 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T13:24:45.198 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2023-07-18T13:24:45.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-07-18T13:24:45.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:24:45.263 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-07-18T13:24:45.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-07-18T13:24:45.334 DEBUG:teuthology.orchestra.run.smithi140:> uname -m 2023-07-18T13:24:45.392 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2023-07-18T13:24:45.393 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-07-18T13:24:45.450 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream" 2023-07-18T13:24:45.450 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8" 2023-07-18T13:24:45.450 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos" 2023-07-18T13:24:45.451 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora" 2023-07-18T13:24:45.451 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8" 2023-07-18T13:24:45.451 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-07-18T13:24:45.451 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-18T13:24:45.451 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-07-18T13:24:45.451 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-18T13:24:45.451 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/" 2023-07-18T13:24:45.452 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T13:24:45.452 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T13:24:45.452 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T13:24:45.453 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-18T13:24:45.471 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-07-18T13:24:45.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-07-18T13:24:45.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T13:24:45.539 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-07-18T13:24:45.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-07-18T13:24:45.610 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-07-18T13:24:45.672 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-07-18T13:24:45.672 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-07-18T13:24:45.732 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-07-18T13:24:45.732 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-07-18T13:24:45.732 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-07-18T13:24:45.732 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-07-18T13:24:45.732 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-07-18T13:24:45.733 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-07-18T13:24:45.733 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-18T13:24:45.733 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-07-18T13:24:45.733 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-18T13:24:45.733 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-07-18T13:24:45.733 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T13:24:45.733 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T13:24:45.734 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T13:24:45.734 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-07-18T13:24:45.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:24:45.755 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:24:45.865 INFO:teuthology.dispatcher.supervisor:Running job 7342874 2023-07-18T13:24:45.865 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-18_12:12:57-orch:cephadm-wip-adk2-testing-2023-07-18-0910-pacific-distro-default-smithi/7342874 --name gabrioux-2023-07-18_12:12:57-orch:cephadm-wip-adk2-testing-2023-07-18-0910-pacific-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/gabrioux-2023-07-18_12:12:57-orch:cephadm-wip-adk2-testing-2023-07-18-0910-pacific-distro-default-smithi/7342874/orig.config.yaml 2023-07-18T13:24:45.869 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-18_12:12:57-orch:cephadm-wip-adk2-testing-2023-07-18-0910-pacific-distro-default-smithi/7342874 2023-07-18T13:24:45.870 INFO:teuthology.dispatcher.supervisor:Job PID: 1384 2023-07-18T13:24:45.870 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-18T13:26:45.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:26:45.970 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:28:46.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:28:46.108 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:30:46.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:30:46.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:32:46.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:32:46.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:34:46.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:34:46.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:36:46.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:36:46.797 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:38:46.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:38:46.973 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:40:47.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:40:47.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:42:47.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:42:47.319 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:44:47.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:44:47.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:46:47.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T13:46:47.673 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T13:46:47.735 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-18T13:46:47.876 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-18T13:46:47.876 INFO:teuthology.nuke:Checking targets against current locks 2023-07-18T13:46:47.931 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-18T13:46:47.931 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T13:46:47.952 DEBUG:teuthology.nuke:shortname: smithi152 2023-07-18T13:46:47.953 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T13:46:47.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-18_12:12:57-orch:cephadm-wip-adk2-testing-2023-07-18-0910-pacific-distro-default-smithi/7342874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 13:19:29.479793', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHVIcnocbkfDns4/Y0OeTK1wHV4iXi0Zo6yA1VaYBqWnf4Ge4/TmncLcE792tfAfi9UF0lsntAB29kOu5EYxntooUocnGY4pvLj2cfBFL1qblraj7z91FvSimwbI+cWXaKIvr2yWXLqq6mg/vNTekj1AsxB5T1WrvyyHvPQNf5hqM7jazd8UZABb94hIm4r+R/naz7+EsOfwF/fSJ0Pfz6bPsfD9zaDAzCmLH2oC8906Sox56PHJr5GayaoCmbB94cOZGoPblMkPwdNUB+rHXPo2fqE3+t4exOcEpgN49/4ip+NUXF5hE5OMDmOFBhcGyu3YbAqmFsiZO7ryxBCbOXR17KcZUkm0fYkdglUdbkpl7qEuvQGdQ+J1k3A7qgZnQnLZFgWsROKMVPo8p3eCELi0tENoDJaY695vw9g3lD+RVcBU06kjcdaIXIDJxJowg2uf50duFHI/LyX1n4yFrurd0W52IlKwkQQIw9Ls9Mw/utH1N1bI8BRDtDsVGJvE='} 2023-07-18T13:46:47.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-18_12:12:57-orch:cephadm-wip-adk2-testing-2023-07-18-0910-pacific-distro-default-smithi/7342874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 13:19:29.482169', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMN9qWCMSItqV++OFq6bcoEIp8p/2yoRe0/dTfuBS6RzshVYFt+mpqXA60tyMydFuR/EKYBO18voUTOrD0eyfUY='} 2023-07-18T13:46:48.014 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-18T13:46:48.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T13:46:48.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:46:48.055 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-18T13:46:48.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T13:46:48.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T13:46:48.165 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-18T13:46:48.200 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-18T13:46:48.317 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-18T13:46:48.350 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com