2023-06-23T15:38:20.802 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-23T15:38:20.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:38:20.803 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:38:20.974 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f43aa7e46a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f43aba028b0>, signals=[15])
2023-06-23T15:38:20.977 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging
2023-06-23T15:38:20.977 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T15:38:20.977 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2023-06-23T15:38:21.013 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2023-06-23T15:38:21.013 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T15:38:21.013 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-06-23T15:38:21.015 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /host {"name": "smithi130"}
2023-06-23T15:38:21.038 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"}
2023-06-23T15:38:21.092 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-23T15:38:21.115 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-23T15:38:21.126 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_8.stream (ID 3)
2023-06-23T15:38:21.127 DEBUG:teuthology.provision.fog.smithi130:FOG request: PUT /host/235 {"imageID": 3}
2023-06-23T15:38:21.158 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_8.stream (ID 3)
2023-06-23T15:38:21.158 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 3}
2023-06-23T15:38:21.171 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 8.stream
2023-06-23T15:38:21.172 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:38:21.203 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream
2023-06-23T15:38:21.203 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:38:21.225 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T15:38:21.255 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T15:38:21.258 DEBUG:teuthology.provision.fog.smithi130:FOG request: POST /host/235/task {"taskTypeID": 1}
2023-06-23T15:38:21.290 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1}
2023-06-23T15:38:21.313 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:38:21.336 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:38:21.403 INFO:teuthology.orchestra.console:Power off smithi130
2023-06-23T15:38:21.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T15:38:21.420 INFO:teuthology.orchestra.console:Power off smithi153
2023-06-23T15:38:21.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T15:38:21.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:21.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:25.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:25.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:29.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:29.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:29.776 INFO:teuthology.orchestra.console:Power off for smithi130 completed
2023-06-23T15:38:29.783 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2023-06-23T15:38:29.877 INFO:teuthology.orchestra.console:Power on smithi130
2023-06-23T15:38:29.878 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T15:38:29.885 INFO:teuthology.orchestra.console:Power on smithi153
2023-06-23T15:38:29.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T15:38:29.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:29.906 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:33.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:33.930 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:38.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:38.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T15:38:38.256 INFO:teuthology.orchestra.console:Power on for smithi153 completed
2023-06-23T15:38:38.262 INFO:teuthology.orchestra.console:Power on for smithi130 completed
2023-06-23T15:38:38.358 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2023-06-23T15:38:38.359 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:38:38.364 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish
2023-06-23T15:38:38.364 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:38:53.448 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:38:53.449 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:39:08.532 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:39:08.533 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:39:23.604 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:39:23.606 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:39:38.677 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:39:38.679 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:39:53.753 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:39:53.755 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:40:08.831 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:40:08.832 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:40:23.904 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:40:23.906 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:40:38.980 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:40:38.982 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:40:54.056 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:40:54.058 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:41:09.120 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:41:09.123 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:41:24.192 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-06-23T15:41:24.193 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:41:24.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:41:39.260 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-06-23T15:41:39.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:41:42.640 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-06-23T15:41:48.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:41:51.700 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-06-23T15:41:57.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:41:57.748 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-06-23T15:42:00.784 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-06-23T15:42:03.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:42:06.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:42:06.836 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-06-23T15:42:09.840 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-06-23T15:42:12.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:42:15.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:42:15.920 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-06-23T15:42:21.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:42:24.976 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-06-23T15:42:30.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:42:34.032 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-06-23T15:42:40.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:42:43.092 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-06-23T15:42:49.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:43:15.872 WARNING:teuthology.provision.fog.smithi130:timed out
2023-06-23T15:43:21.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:43:22.129 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T15:43:22.130 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T15:43:22.395 INFO:teuthology.provision.fog.smithi130:Node is ready
2023-06-23T15:43:22.396 DEBUG:teuthology.orchestra.run.smithi130:> hostname
2023-06-23T15:43:22.414 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com
2023-06-23T15:43:22.415 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts
2023-06-23T15:43:22.473 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130
2023-06-23T15:43:22.473 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2023-06-23T15:43:22.579 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts
2023-06-23T15:43:22.607 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts
2023-06-23T15:43:22.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname
2023-06-23T15:43:22.743 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2023-06-23T15:43:22.814 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2023-06-23T15:43:22.872 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2023-06-23T15:43:22.872 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8"
2023-06-23T15:43:22.872 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2023-06-23T15:43:22.873 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T15:43:22.874 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T15:43:22.874 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T15:43:22.874 INFO:teuthology.provision.fog.smithi130:Deploy complete!
2023-06-23T15:43:22.876 DEBUG:teuthology.parallel:result is None
2023-06-23T15:43:49.124 WARNING:teuthology.provision.fog.smithi153:timed out
2023-06-23T15:43:55.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:43:55.319 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T15:43:55.320 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T15:43:55.571 INFO:teuthology.provision.fog.smithi153:Node is ready
2023-06-23T15:43:55.572 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2023-06-23T15:43:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2023-06-23T15:43:55.591 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2023-06-23T15:43:55.650 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2023-06-23T15:43:55.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-06-23T15:43:55.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2023-06-23T15:43:55.778 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2023-06-23T15:43:55.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2023-06-23T15:43:55.915 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-06-23T15:43:55.982 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-06-23T15:43:56.040 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2023-06-23T15:43:56.175 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8"
2023-06-23T15:43:56.175 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2023-06-23T15:43:56.175 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2023-06-23T15:43:56.175 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8"
2023-06-23T15:43:56.175 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-06-23T15:43:56.175 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T15:43:56.177 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-06-23T15:43:56.177 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T15:43:56.177 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2023-06-23T15:43:56.178 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T15:43:56.178 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T15:43:56.178 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T15:43:56.178 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2023-06-23T15:43:56.179 DEBUG:teuthology.parallel:result is None
2023-06-23T15:43:56.395 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com
2023-06-23T15:43:56.397 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T15:43:56.428 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2023-06-23T15:43:56.429 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T15:43:56.456 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server
2023-06-23T15:43:56.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com'
2023-06-23T15:43:56.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:43:56.527 DEBUG:teuthology.orchestra.run.smithi130:> true
2023-06-23T15:43:56.668 DEBUG:teuthology.orchestra.run.smithi130:> uname -m
2023-06-23T15:43:56.730 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64
2023-06-23T15:43:56.731 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2023-06-23T15:43:56.789 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2023-06-23T15:43:56.789 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8"
2023-06-23T15:43:56.790 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2023-06-23T15:43:56.790 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2023-06-23T15:43:56.790 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8"
2023-06-23T15:43:56.790 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8"
2023-06-23T15:43:56.790 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T15:43:56.790 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2023-06-23T15:43:56.791 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T15:43:56.791 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2023-06-23T15:43:56.791 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T15:43:56.791 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T15:43:56.791 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T15:43:56.792 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2023-06-23T15:43:56.812 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2023-06-23T15:43:56.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-06-23T15:43:56.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T15:43:56.880 DEBUG:teuthology.orchestra.run.smithi153:> true
2023-06-23T15:43:56.956 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2023-06-23T15:43:57.016 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2023-06-23T15:43:57.017 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-06-23T15:43:57.077 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2023-06-23T15:43:57.077 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8"
2023-06-23T15:43:57.077 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2023-06-23T15:43:57.078 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2023-06-23T15:43:57.078 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8"
2023-06-23T15:43:57.078 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-06-23T15:43:57.078 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T15:43:57.079 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-06-23T15:43:57.079 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T15:43:57.079 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2023-06-23T15:43:57.079 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T15:43:57.080 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T15:43:57.080 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T15:43:57.081 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-06-23T15:43:57.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:43:57.104 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:43:57.215 INFO:teuthology.dispatcher.supervisor:Running job 7313403
2023-06-23T15:43:57.215 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-06-22_22:38:51-fs-wip-pdonnell-testing-20230622.184117-distro-default-smithi/7313403 --name pdonnell-2023-06-22_22:38:51-fs-wip-pdonnell-testing-20230622.184117-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2023-06-22_22:38:51-fs-wip-pdonnell-testing-20230622.184117-distro-default-smithi/7313403/orig.config.yaml
2023-06-23T15:43:57.220 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-06-22_22:38:51-fs-wip-pdonnell-testing-20230622.184117-distro-default-smithi/7313403
2023-06-23T15:43:57.221 INFO:teuthology.dispatcher.supervisor:Job PID: 25410
2023-06-23T15:43:57.221 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-23T15:45:57.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:45:57.322 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:47:57.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:47:57.497 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:49:57.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:49:57.674 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:51:57.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:51:57.847 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:53:58.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:53:58.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:55:58.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:55:58.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:57:58.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:57:58.358 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T15:59:58.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T15:59:58.525 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T16:01:58.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T16:01:58.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T16:03:58.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T16:03:58.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T16:03:58.935 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-23T16:03:59.099 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-23T16:03:59.099 INFO:teuthology.nuke:Checking targets against current locks
2023-06-23T16:03:59.151 DEBUG:teuthology.nuke:shortname: smithi130
2023-06-23T16:03:59.152 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T16:03:59.176 DEBUG:teuthology.nuke:shortname: smithi153
2023-06-23T16:03:59.176 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T16:03:59.179 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-22_22:38:51-fs-wip-pdonnell-testing-20230622.184117-distro-default-smithi/7313403', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 15:38:19.968988', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBcEbn57ot6uVNroU1xd5rRjTgmvePt2TQDRlr58WxHWjVQbqIDY8LmE/3Dx8qcDfkELTAiX1cmJf083vzlF39Et+oX9S+DobDeNNWElEqD+rDShEG1KfgyiSljavTy+cjmtEoNNtLMyRuQvBONVcuLeVjKebUXanXEuRpCuqDP0YessI/EVPhBL20fuulsip02BOTNh3sXwgQqAB0UVGIlrz+72LBNn6tQCe2VGKs7h/XfrZfmh6Zjo8ubfJ4Lq7nSYF2sKNkxys3sU58kfhShdrqQsyy8b+m1cm2iACuBVrZ2HRpHkZjeZ4nYXo3Pmh30T36vcnRZHu89XvG4X2Yvv8usARx32f8b3gS4GoO6/4HHKkB+VGyedF7LflVtbJMXtb7ctj7kntk/lQd5SxoH3vXZbe0PGJgzTvpYae6YLY9P+uxDAGuEKpsv8rs7iFKpN64GdbAdlti96nDXZhEKeEOHYrLUyJAN3igXer85pH7to6ZkZQ1MKThMso88lU='}
2023-06-23T16:03:59.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-22_22:38:51-fs-wip-pdonnell-testing-20230622.184117-distro-default-smithi/7313403', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 15:38:19.967130', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWySKN2ma8yIzmS+gsjqqudbTnBPpFaAcxO3j7sCb71dxyIBuVj/C+lNr7Q1Z/Sqjx0T7BDko0YdNl2L+MnNGD3nwnVy4m/gzJnUcq9DTtkUKA9gSxak7NUDq9wCQSQJoJ/peG24ELa9TTHUScLoiOim5ppQd6++yLvtR4CEJs2aE+UxmvGNblZJO96aLMXAdC9yzPlXs2HedXSbhAZ1Hxs8Ji1hmSaC+vI48t0JjPAyA3iRGk5WyHIA6aaOuDOvytGC3ob/FmM1LDpk60hettqc2Hy2bBpSDC6E9GSdfOh7ba2miNqG5Wc8x8o/c1hl6Pqfhhgs49sot/JzcUDVUCf8tacyv/FeuKriiayMiZDDxpzGV88/r/nZT3O1Rz2CeWJIWPNF0zpNKF3kXstYXyU/MhhTTsZ5IMMB45eq1cax0YAh31STVFe3ukIH1DTy7jPl8tw6jzouqeQndY2hi8uRHpG6hQ3pcrKdCxDeVJE5sgSyOqQrU7rL7Wt6ajbrs='}
2023-06-23T16:03:59.232 INFO:teuthology.orchestra.console:Power off smithi130
2023-06-23T16:03:59.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T16:03:59.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T16:03:59.271 INFO:teuthology.orchestra.console:Power off smithi153
2023-06-23T16:03:59.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T16:03:59.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T16:03:59.382 INFO:teuthology.orchestra.console:Power off for smithi130 completed
2023-06-23T16:03:59.415 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2023-06-23T16:03:59.541 INFO:teuthology.lock.ops:unlocked: smithi130.front.sepia.ceph.com
2023-06-23T16:03:59.559 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com