2023-11-15T03:48:51.485 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-15T03:48:51.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T03:48:51.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1f9475db50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1f95249670>, signals=[15])
2023-11-15T03:48:51.630 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging
2023-11-15T03:48:51.630 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server
2023-11-15T03:48:51.630 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2023-11-15T03:48:51.659 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-11-15T03:48:51.660 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-11-15T03:48:51.660 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-11-15T03:48:51.661 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /host {"name": "smithi018"}
2023-11-15T03:48:51.684 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"}
2023-11-15T03:48:51.732 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-15T03:48:51.748 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-15T03:48:51.769 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_centos_8.stream (ID 3)
2023-11-15T03:48:51.770 DEBUG:teuthology.provision.fog.smithi018:FOG request: PUT /host/124 {"imageID": 3}
2023-11-15T03:48:51.789 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_8.stream (ID 3)
2023-11-15T03:48:51.790 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 3}
2023-11-15T03:48:51.817 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 8.stream
2023-11-15T03:48:51.818 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:48:51.833 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.stream
2023-11-15T03:48:51.833 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:48:51.896 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /tasktype {"name": "deploy"}
2023-11-15T03:48:51.901 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"}
2023-11-15T03:48:51.937 DEBUG:teuthology.provision.fog.smithi018:FOG request: POST /host/124/task {"taskTypeID": 1}
2023-11-15T03:48:51.941 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1}
2023-11-15T03:48:51.992 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:48:51.995 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:48:52.099 INFO:teuthology.orchestra.console.smithi018:Power off
2023-11-15T03:48:52.099 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T03:48:52.112 INFO:teuthology.orchestra.console.smithi111:Power off
2023-11-15T03:48:52.113 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T03:48:52.121 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off
2023-11-15T03:48:52.122 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:48:52.137 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-11-15T03:48:52.137 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:48:52.145 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2023-11-15T03:48:52.160 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-11-15T03:48:56.146 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:48:56.161 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:48:56.256 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2023-11-15T03:48:56.270 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-11-15T03:49:00.259 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:00.271 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:00.370 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-11-15T03:49:00.382 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-11-15T03:49:00.471 INFO:teuthology.orchestra.console.smithi018:Power off completed
2023-11-15T03:49:00.571 INFO:teuthology.orchestra.console.smithi018:Power on
2023-11-15T03:49:00.572 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-15T03:49:00.596 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On
2023-11-15T03:49:00.597 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:00.621 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-11-15T03:49:04.386 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:04.495 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-11-15T03:49:04.596 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-11-15T03:49:04.623 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:04.697 INFO:teuthology.orchestra.console.smithi111:Power on
2023-11-15T03:49:04.698 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-15T03:49:04.720 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-11-15T03:49:04.721 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:04.732 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-11-15T03:49:04.741 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-11-15T03:49:08.738 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:08.745 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:08.848 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2023-11-15T03:49:08.854 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-11-15T03:49:08.949 INFO:teuthology.orchestra.console.smithi018:Power on completed
2023-11-15T03:49:09.050 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish
2023-11-15T03:49:09.051 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:49:12.859 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T03:49:12.968 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-11-15T03:49:13.069 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-11-15T03:49:13.170 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-11-15T03:49:13.171 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:49:24.146 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:49:28.246 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:49:39.237 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:49:43.318 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:49:54.314 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:49:58.382 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:50:09.382 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:50:13.447 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:50:24.462 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:50:28.509 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:50:39.547 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:50:43.582 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:50:54.619 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:50:58.653 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:51:09.703 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:51:13.722 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:51:24.794 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:51:28.790 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:51:39.872 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-11-15T03:51:39.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:51:43.002 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-11-15T03:51:43.858 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:51:49.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:51:52.058 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-11-15T03:51:58.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:51:58.920 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:52:01.114 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-11-15T03:52:07.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:10.170 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-11-15T03:52:13.986 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-15T03:52:14.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:16.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:17.117 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:52:19.226 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-11-15T03:52:23.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:25.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:26.170 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:52:28.282 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-11-15T03:52:32.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:34.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:35.226 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:52:41.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:44.314 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:52:50.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:52:53.402 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:52:59.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:53:02.493 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:53:08.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:53:11.582 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:53:17.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:53:20.670 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-15T03:53:26.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:53:34.294 WARNING:teuthology.provision.fog.smithi018:timed out
2023-11-15T03:53:40.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:53:40.567 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-15T03:53:40.568 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-15T03:53:40.785 INFO:teuthology.provision.fog.smithi018:Node is ready
2023-11-15T03:53:40.786 DEBUG:teuthology.orchestra.run.smithi018:> hostname
2023-11-15T03:53:40.805 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com
2023-11-15T03:53:40.805 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts
2023-11-15T03:53:40.864 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018
2023-11-15T03:53:40.865 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2023-11-15T03:53:40.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts
2023-11-15T03:53:41.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts
2023-11-15T03:53:41.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname
2023-11-15T03:53:41.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2023-11-15T03:53:41.233 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2023-11-15T03:53:41.292 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2023-11-15T03:53:41.292 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8"
2023-11-15T03:53:41.292 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2023-11-15T03:53:41.292 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2023-11-15T03:53:41.293 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8"
2023-11-15T03:53:41.293 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8"
2023-11-15T03:53:41.293 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-15T03:53:41.293 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2023-11-15T03:53:41.293 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-15T03:53:41.294 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2023-11-15T03:53:41.294 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T03:53:41.294 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-15T03:53:41.294 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T03:53:41.295 INFO:teuthology.provision.fog.smithi018:Deploy complete!
2023-11-15T03:53:41.296 DEBUG:teuthology.parallel:result is None
2023-11-15T03:54:26.722 WARNING:teuthology.provision.fog.smithi111:timed out
2023-11-15T03:54:32.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:54:32.937 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-15T03:54:32.937 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-15T03:54:33.185 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-11-15T03:54:33.186 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-11-15T03:54:33.205 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-11-15T03:54:33.206 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-11-15T03:54:33.264 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-11-15T03:54:33.265 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-11-15T03:54:33.372 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-11-15T03:54:33.401 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-11-15T03:54:33.471 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-11-15T03:54:33.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-11-15T03:54:33.606 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-11-15T03:54:33.664 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2023-11-15T03:54:33.665 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2023-11-15T03:54:33.665 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2023-11-15T03:54:33.665 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2023-11-15T03:54:33.666 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2023-11-15T03:54:33.666 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-11-15T03:54:33.669 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-15T03:54:33.669 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-11-15T03:54:33.670 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-15T03:54:33.670 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2023-11-15T03:54:33.670 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T03:54:33.670 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-15T03:54:33.671 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T03:54:33.671 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-11-15T03:54:33.672 DEBUG:teuthology.parallel:result is None
2023-11-15T03:54:33.862 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com
2023-11-15T03:54:33.863 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-15T03:54:33.888 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-11-15T03:54:33.888 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-15T03:54:33.913 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server
2023-11-15T03:54:33.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2023-11-15T03:54:33.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:54:33.984 DEBUG:teuthology.orchestra.run.smithi018:> true
2023-11-15T03:54:34.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com'
2023-11-15T03:54:34.126 DEBUG:teuthology.orchestra.run.smithi018:> uname -m
2023-11-15T03:54:34.187 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64
2023-11-15T03:54:34.188 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2023-11-15T03:54:34.247 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2023-11-15T03:54:34.248 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8"
2023-11-15T03:54:34.248 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2023-11-15T03:54:34.248 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2023-11-15T03:54:34.248 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8"
2023-11-15T03:54:34.249 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8"
2023-11-15T03:54:34.249 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-15T03:54:34.249 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2023-11-15T03:54:34.250 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-15T03:54:34.250 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2023-11-15T03:54:34.250 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T03:54:34.251 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-15T03:54:34.251 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T03:54:34.252 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2023-11-15T03:54:34.279 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-11-15T03:54:34.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-11-15T03:54:34.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T03:54:34.346 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-11-15T03:54:34.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-11-15T03:54:34.372 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-11-15T03:54:34.430 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-11-15T03:54:34.431 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-11-15T03:54:34.490 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2023-11-15T03:54:34.491 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2023-11-15T03:54:34.492 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2023-11-15T03:54:34.493 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2023-11-15T03:54:34.493 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2023-11-15T03:54:34.493 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-11-15T03:54:34.493 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-15T03:54:34.493 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-11-15T03:54:34.494 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-15T03:54:34.494 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2023-11-15T03:54:34.494 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T03:54:34.495 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-15T03:54:34.495 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T03:54:34.496 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-11-15T03:54:34.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T03:54:34.628 INFO:teuthology.dispatcher.supervisor:Running job 7458317
2023-11-15T03:54:34.629 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458317 --name yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458317/orig.config.yaml
2023-11-15T03:54:34.632 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458317
2023-11-15T03:54:34.633 INFO:teuthology.dispatcher.supervisor:Job PID: 2221560
2023-11-15T03:54:34.633 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-15T03:56:34.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T03:58:34.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:00:35.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:02:35.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:04:35.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:06:35.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:08:35.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:10:35.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:12:36.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:14:36.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:16:36.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:18:36.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T04:18:36.590 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-15T04:18:36.704 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-15T04:18:36.705 INFO:teuthology.nuke:Checking targets against current locks
2023-11-15T04:18:36.758 DEBUG:teuthology.nuke:shortname: smithi018
2023-11-15T04:18:36.758 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-15T04:18:36.780 DEBUG:teuthology.nuke:shortname: smithi111
2023-11-15T04:18:36.780 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-15T04:18:36.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458317', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 03:48:50.674493', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYXsW5o0GF7jSAC5AM5mzd6V8dvVNyICUBfo0LiV//U9Cwg4t+aR0rFZ/RAhtELVsUdOVqn0T+M4K/YvvYJYzk='}
2023-11-15T04:18:36.805 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:45:49-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458317', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 03:48:50.676504', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3IJPs11tDlYhO00/C+kZ6QjKcQiCOJCOde1ILWTRJ99SAKZX/bZwodqgZ/hjcG0+XdML21PfMBBCfplvV4qjQ='}
2023-11-15T04:18:36.836 INFO:teuthology.orchestra.console.smithi018:Power off
2023-11-15T04:18:36.837 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T04:18:36.860 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off
2023-11-15T04:18:36.861 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T04:18:36.882 INFO:teuthology.orchestra.console.smithi111:Power off
2023-11-15T04:18:36.883 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T04:18:36.898 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-11-15T04:18:36.907 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-11-15T04:18:36.907 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T04:18:36.938 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-11-15T04:18:36.999 INFO:teuthology.orchestra.console.smithi018:Power off completed
2023-11-15T04:18:37.040 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-11-15T04:18:37.148 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com
2023-11-15T04:18:37.189 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com