2023-11-17T05:05:07.125 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-17T05:05:07.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:05:07.315 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f032dc18940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f032e70c670>, signals=[15])
2023-11-17T05:05:07.315 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging
2023-11-17T05:05:07.315 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server
2023-11-17T05:05:07.315 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2023-11-17T05:05:07.340 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-11-17T05:05:07.340 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-11-17T05:05:07.340 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-11-17T05:05:07.342 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"}
2023-11-17T05:05:07.365 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"}
2023-11-17T05:05:07.409 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-17T05:05:07.445 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-17T05:05:07.448 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_8.stream (ID 3)
2023-11-17T05:05:07.448 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 3}
2023-11-17T05:05:07.487 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3)
2023-11-17T05:05:07.487 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3}
2023-11-17T05:05:07.492 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream
2023-11-17T05:05:07.492 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:05:07.549 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream
2023-11-17T05:05:07.549 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:05:07.552 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"}
2023-11-17T05:05:07.590 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1}
2023-11-17T05:05:07.603 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"}
2023-11-17T05:05:07.645 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:05:07.648 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1}
2023-11-17T05:05:07.711 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:05:07.783 INFO:teuthology.orchestra.console.smithi173:Power off
2023-11-17T05:05:07.783 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T05:05:07.820 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off
2023-11-17T05:05:07.820 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:07.847 INFO:teuthology.orchestra.console.smithi203:Power off
2023-11-17T05:05:07.848 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T05:05:07.861 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2023-11-17T05:05:07.877 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-11-17T05:05:07.877 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:07.928 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-11-17T05:05:11.866 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:11.931 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:11.988 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2023-11-17T05:05:12.091 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-11-17T05:05:15.991 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:16.093 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:16.114 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2023-11-17T05:05:16.205 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-17T05:05:16.306 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-11-17T05:05:16.406 INFO:teuthology.orchestra.console.smithi203:Power on
2023-11-17T05:05:16.407 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-17T05:05:16.433 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-11-17T05:05:16.433 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:16.457 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-17T05:05:20.118 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:20.232 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2023-11-17T05:05:20.333 INFO:teuthology.orchestra.console.smithi173:Power off completed
2023-11-17T05:05:20.458 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:20.499 INFO:teuthology.orchestra.console.smithi173:Power on
2023-11-17T05:05:20.499 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-17T05:05:20.532 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On
2023-11-17T05:05:20.533 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:20.557 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2023-11-17T05:05:20.575 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-17T05:05:24.560 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:24.576 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:05:24.675 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2023-11-17T05:05:24.775 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-11-17T05:05:24.776 INFO:teuthology.orchestra.console.smithi173:Power on completed
2023-11-17T05:05:24.876 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-11-17T05:05:24.878 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish
2023-11-17T05:05:24.878 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:05:24.977 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-11-17T05:05:24.977 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:05:39.946 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:06:07.337 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:06:22.422 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:06:22.424 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:06:37.490 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:06:37.491 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:06:52.556 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:06:52.558 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:07:07.626 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:07:07.627 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:07:22.699 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:07:22.700 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:07:37.770 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:07:37.772 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:07:52.850 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:07:52.851 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:08:07.920 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-11-17T05:08:12.675 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-17T05:08:12.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:08:12.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:08:15.834 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-17T05:09:01.758 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-17T05:09:07.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:09:07.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:09:10.843 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-17T05:09:10.843 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-17T05:09:16.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:09:16.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:09:19.930 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-17T05:09:25.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:09:29.018 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-17T05:09:35.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:09:35.272 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-17T05:09:35.273 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-17T05:10:00.134 INFO:teuthology.provision.fog.smithi173:Node is ready
2023-11-17T05:10:00.134 DEBUG:teuthology.orchestra.run.smithi173:> hostname
2023-11-17T05:10:00.159 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com
2023-11-17T05:10:00.159 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts
2023-11-17T05:10:00.220 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173
2023-11-17T05:10:00.220 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2023-11-17T05:10:00.332 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts
2023-11-17T05:10:00.363 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts
2023-11-17T05:10:00.433 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname
2023-11-17T05:10:00.503 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2023-11-17T05:10:00.571 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T05:10:00.630 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2023-11-17T05:10:00.631 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T05:10:00.631 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T05:10:00.631 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T05:10:00.631 INFO:teuthology.provision.fog.smithi173:Deploy complete!
2023-11-17T05:10:00.633 DEBUG:teuthology.parallel:result is None
2023-11-17T05:10:16.866 WARNING:teuthology.provision.fog.smithi203:timed out
2023-11-17T05:10:22.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:10:23.126 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-17T05:10:23.127 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-17T05:10:23.366 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-11-17T05:10:23.367 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-11-17T05:10:23.387 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-11-17T05:10:23.387 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-11-17T05:10:23.446 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-11-17T05:10:23.447 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-11-17T05:10:23.547 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-11-17T05:10:23.577 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-11-17T05:10:23.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-11-17T05:10:23.716 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-11-17T05:10:23.786 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-11-17T05:10:23.844 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-11-17T05:10:23.844 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-11-17T05:10:23.844 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-11-17T05:10:23.844 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-11-17T05:10:23.844 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T05:10:23.845 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T05:10:23.845 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-11-17T05:10:23.846 DEBUG:teuthology.parallel:result is None
2023-11-17T05:10:24.066 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com
2023-11-17T05:10:24.067 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-17T05:10:24.113 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-11-17T05:10:24.113 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-17T05:10:24.139 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server
2023-11-17T05:10:24.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2023-11-17T05:10:24.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:10:24.251 DEBUG:teuthology.orchestra.run.smithi173:> true
2023-11-17T05:10:24.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com'
2023-11-17T05:10:24.385 DEBUG:teuthology.orchestra.run.smithi173:> uname -m
2023-11-17T05:10:24.444 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64
2023-11-17T05:10:24.445 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8"
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8"
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8"
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T05:10:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2023-11-17T05:10:24.505 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T05:10:24.505 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2023-11-17T05:10:24.505 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T05:10:24.505 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T05:10:24.505 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T05:10:24.506 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2023-11-17T05:10:24.532 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-11-17T05:10:24.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-11-17T05:10:24.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T05:10:24.613 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-11-17T05:10:24.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-11-17T05:10:24.684 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-11-17T05:10:24.743 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-11-17T05:10:24.743 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-11-17T05:10:24.802 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-11-17T05:10:24.802 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T05:10:24.803 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-11-17T05:10:24.804 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T05:10:24.804 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T05:10:24.804 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T05:10:24.804 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-11-17T05:10:24.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:10:24.928 INFO:teuthology.dispatcher.supervisor:Running job 7461281
2023-11-17T05:10:24.928 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461281 --name yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461281/orig.config.yaml
2023-11-17T05:10:24.932 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461281
2023-11-17T05:10:24.934 INFO:teuthology.dispatcher.supervisor:Job PID: 181553
2023-11-17T05:10:24.934 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-17T05:12:25.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:14:25.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:16:40.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:18:53.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:20:53.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:23:24.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:25:25.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:27:25.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:29:25.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:32:24.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:34:24.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:36:24.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:38:25.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:40:25.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:42:25.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:44:25.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:46:28.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:48:28.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:50:29.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:53:20.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:55:22.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:57:22.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:59:22.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:01:22.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:03:26.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:05:26.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:07:30.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:10:09.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:12:09.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:14:13.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:16:14.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:18:14.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:20:14.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:22:22.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:24:22.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:26:23.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:28:30.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:30:30.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:32:30.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:34:58.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:36:58.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:38:58.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:40:58.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:42:59.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:44:59.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:47:06.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:49:06.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:51:06.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:53:06.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:55:17.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:57:18.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T06:57:18.152 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-17T06:57:18.352 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-17T06:57:18.352 INFO:teuthology.nuke:Checking targets against current locks
2023-11-17T06:57:18.403 DEBUG:teuthology.nuke:shortname: smithi173
2023-11-17T06:57:18.403 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-17T06:57:18.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461281', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 05:05:06.160887', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKzlVEwZbDm8S25/uCPAvpw/umecw3cf+epLIdejKGkppidsuReFIac16OaKDAOHUHuiTSoLDw2c45T3BBRtsc='}
2023-11-17T06:57:18.427 DEBUG:teuthology.nuke:shortname: smithi203
2023-11-17T06:57:18.427 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-17T06:57:18.444 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461281', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 05:05:06.159561', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMDvtWAKqtfr/FBE4M3sHqXlgp4xBvucpC5lh3iBQrbffuKnCpMOyoSrqBrm+IuR6OF9SENLweWsDZEopXx6CT4='}
2023-11-17T06:57:18.477 INFO:teuthology.orchestra.console.smithi173:Power off
2023-11-17T06:57:18.477 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T06:57:18.492 INFO:teuthology.orchestra.console.smithi203:Power off
2023-11-17T06:57:18.493 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T06:57:18.500 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off
2023-11-17T06:57:18.500 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T06:57:18.512 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-11-17T06:57:18.513 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T06:57:18.521 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2023-11-17T06:57:18.533 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-17T06:57:18.622 INFO:teuthology.orchestra.console.smithi173:Power off completed
2023-11-17T06:57:18.634 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-11-17T06:57:18.767 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com
2023-11-17T06:57:18.775 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com