2023-09-02T01:04:37.211 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-02T01:04:37.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-02T01:04:37.339 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc454b01c10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc455606670>, signals=[15])
2023-09-02T01:04:37.340 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2023-09-02T01:04:37.341 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2023-09-02T01:04:37.341 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-09-02T01:04:37.362 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-09-02T01:04:37.362 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-09-02T01:04:37.363 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-09-02T01:04:37.364 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"}
2023-09-02T01:04:37.386 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"}
2023-09-02T01:04:37.439 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-02T01:04:37.447 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-02T01:04:37.481 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10)
2023-09-02T01:04:37.481 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 10}
2023-09-02T01:04:37.487 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10)
2023-09-02T01:04:37.487 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 10}
2023-09-02T01:04:37.525 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream
2023-09-02T01:04:37.525 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:04:37.529 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream
2023-09-02T01:04:37.529 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:04:37.684 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"}
2023-09-02T01:04:37.688 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"}
2023-09-02T01:04:37.725 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1}
2023-09-02T01:04:37.728 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1}
2023-09-02T01:04:37.778 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:04:37.802 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:04:37.964 INFO:teuthology.orchestra.console.smithi203:Power off
2023-09-02T01:04:37.965 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-02T01:04:37.976 INFO:teuthology.orchestra.console.smithi002:Power off
2023-09-02T01:04:37.977 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-02T01:04:37.985 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-09-02T01:04:37.985 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:37.997 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2023-09-02T01:04:37.997 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:38.006 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-09-02T01:04:38.017 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-09-02T01:04:42.010 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:42.018 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:42.118 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-09-02T01:04:42.127 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-09-02T01:04:46.122 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:46.128 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:46.230 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-09-02T01:04:46.236 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-09-02T01:04:50.234 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:50.240 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:50.342 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-09-02T01:04:50.348 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-09-02T01:04:50.444 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-09-02T01:04:50.449 INFO:teuthology.orchestra.console.smithi002:Power off completed
2023-09-02T01:04:50.545 INFO:teuthology.orchestra.console.smithi203:Power on
2023-09-02T01:04:50.545 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-02T01:04:50.552 INFO:teuthology.orchestra.console.smithi002:Power on
2023-09-02T01:04:50.552 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-02T01:04:50.564 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-09-02T01:04:50.565 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:50.573 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On
2023-09-02T01:04:50.573 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:50.588 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-09-02T01:04:50.592 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-09-02T01:04:54.593 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:54.599 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:54.701 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-09-02T01:04:54.708 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-09-02T01:04:58.707 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:58.712 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:04:58.815 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-09-02T01:04:58.821 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-09-02T01:04:58.916 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-09-02T01:04:58.922 INFO:teuthology.orchestra.console.smithi002:Power on completed
2023-09-02T01:04:59.017 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-09-02T01:04:59.018 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:04:59.023 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2023-09-02T01:04:59.023 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:05:14.344 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:05:14.359 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:05:29.599 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:05:29.664 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:05:44.869 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:05:44.971 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:06:00.132 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:06:00.258 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:06:15.443 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:06:15.567 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:06:30.773 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:06:30.879 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:06:46.155 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:06:46.279 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:07:01.817 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:07:01.818 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:07:20.530 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:07:21.599 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:07:44.203 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:07:44.692 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:08:06.832 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:08:07.810 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:08:29.001 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:08:29.165 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:08:45.082 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:08:45.185 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:09:01.870 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:09:01.890 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:09:18.161 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:09:18.295 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:09:34.594 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:09:34.738 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:09:52.094 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:09:52.234 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-09-02T01:09:54.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:10:08.694 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:10:12.378 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-09-02T01:10:18.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:10:21.436 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-09-02T01:10:26.362 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:10:27.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:10:30.490 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-09-02T01:10:36.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:10:43.395 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:10:59.298 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:11:15.170 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:11:30.574 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:11:36.505 WARNING:teuthology.provision.fog.smithi002:timed out
2023-09-02T01:11:42.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:11:42.770 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-02T01:11:42.771 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-02T01:11:43.098 INFO:teuthology.provision.fog.smithi002:Node is ready
2023-09-02T01:11:43.099 DEBUG:teuthology.orchestra.run.smithi002:> hostname
2023-09-02T01:11:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2023-09-02T01:11:43.114 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts
2023-09-02T01:11:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2023-09-02T01:11:43.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2023-09-02T01:11:43.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts
2023-09-02T01:11:43.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts
2023-09-02T01:11:43.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname
2023-09-02T01:11:43.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2023-09-02T01:11:43.518 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2023-09-02T01:11:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-09-02T01:11:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2023-09-02T01:11:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-09-02T01:11:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-09-02T01:11:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2023-09-02T01:11:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2023-09-02T01:11:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-02T01:11:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-09-02T01:11:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2023-09-02T01:11:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-02T01:11:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-09-02T01:11:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-02T01:11:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-02T01:11:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-02T01:11:43.577 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2023-09-02T01:11:43.578 DEBUG:teuthology.parallel:result is None
2023-09-02T01:11:45.766 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:12:00.926 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:12:16.126 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:12:31.316 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:12:46.474 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:13:01.619 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-02T01:13:01.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:13:04.826 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:13:10.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:13:13.882 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:13:19.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:13:22.970 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:13:28.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:13:32.030 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:13:38.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:13:41.114 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:13:47.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:13:50.170 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:13:56.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:14:14.558 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:14:20.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:14:23.642 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:14:29.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:14:32.702 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-02T01:14:38.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:14:38.914 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-02T01:14:38.915 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-02T01:14:59.257 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-09-02T01:14:59.257 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-09-02T01:14:59.316 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-09-02T01:14:59.317 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-09-02T01:14:59.374 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-09-02T01:14:59.374 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-09-02T01:14:59.507 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-09-02T01:14:59.538 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-09-02T01:14:59.607 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-09-02T01:14:59.676 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-09-02T01:14:59.744 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-09-02T01:14:59.799 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-09-02T01:14:59.799 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9"
2023-09-02T01:14:59.799 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-09-02T01:14:59.800 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-09-02T01:14:59.800 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9"
2023-09-02T01:14:59.800 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9"
2023-09-02T01:14:59.800 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-02T01:14:59.801 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-09-02T01:14:59.801 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon"
2023-09-02T01:14:59.801 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-02T01:14:59.801 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-09-02T01:14:59.802 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-02T01:14:59.802 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-02T01:14:59.802 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-02T01:14:59.802 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-09-02T01:14:59.803 DEBUG:teuthology.parallel:result is None
2023-09-02T01:14:59.972 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2023-09-02T01:14:59.973 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-02T01:14:59.993 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-09-02T01:14:59.993 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-02T01:15:00.019 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2023-09-02T01:15:00.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-09-02T01:15:00.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:15:00.118 DEBUG:teuthology.orchestra.run.smithi002:> true
2023-09-02T01:15:00.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-09-02T01:15:00.301 DEBUG:teuthology.orchestra.run.smithi002:> uname -m
2023-09-02T01:15:00.356 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2023-09-02T01:15:00.356 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2023-09-02T01:15:00.412 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-09-02T01:15:00.412 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2023-09-02T01:15:00.412 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-09-02T01:15:00.412 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-09-02T01:15:00.413 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2023-09-02T01:15:00.413 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2023-09-02T01:15:00.413 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-02T01:15:00.413 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-09-02T01:15:00.413 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2023-09-02T01:15:00.414 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-02T01:15:00.414 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-09-02T01:15:00.414 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-02T01:15:00.414 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-02T01:15:00.415 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-02T01:15:00.415 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-09-02T01:15:00.435 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-09-02T01:15:00.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-09-02T01:15:00.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-02T01:15:00.516 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-09-02T01:15:00.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-09-02T01:15:00.587 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-09-02T01:15:00.642 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-09-02T01:15:00.642 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-09-02T01:15:00.697 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-09-02T01:15:00.698 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9"
2023-09-02T01:15:00.698 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-09-02T01:15:00.698 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-09-02T01:15:00.698 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9"
2023-09-02T01:15:00.699 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9"
2023-09-02T01:15:00.699 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-02T01:15:00.699 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-09-02T01:15:00.699 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon"
2023-09-02T01:15:00.700 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-02T01:15:00.700 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-09-02T01:15:00.700 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-02T01:15:00.700 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-02T01:15:00.700 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-02T01:15:00.701 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-09-02T01:15:00.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-02T01:15:00.836 INFO:teuthology.dispatcher.supervisor:Running job 7386711
2023-09-02T01:15:00.836 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386711 --name pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} -- /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386711/orig.config.yaml
2023-09-02T01:15:00.839 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386711
2023-09-02T01:15:00.840 INFO:teuthology.dispatcher.supervisor:Job PID: 463356
2023-09-02T01:15:00.840 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-02T01:17:00.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-02T01:19:01.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-02T01:21:01.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-02T01:23:01.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-02T01:25:01.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-02T01:25:01.712 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-02T01:25:01.818 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-02T01:25:01.818 INFO:teuthology.nuke:Checking targets against current locks
2023-09-02T01:25:01.867 DEBUG:teuthology.nuke:shortname: smithi002
2023-09-02T01:25:01.867 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-02T01:25:01.890 DEBUG:teuthology.nuke:shortname: smithi203
2023-09-02T01:25:01.891 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-02T01:25:01.895 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:04:36.481267', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4+FYmY5wdBZ/Z85Btv744W+ocGPRpQpTn6iDfhLfNueOPNqMdk0UwLJBTriEJ8ARCLqLV3T6y2aNayhlSh/hUqhBORybtFQEJA/+tON8ImmdcGEO32izqcG+z7ckLSNRGQ+HUwdUAzs+ZNh7k+UZDjuSTrcuf7xnHJGEJvlzjQn4C3TW9pULMwwSmmKzBtuzBbaRlT3o+jLnHS+OqleqHvUD6va4cs54TbTnAlxLQA/FVuhGtKiKHgLa4KtFG4XXN/yG5qaTsTgOEaE1TAPC6A+sHtC6GuWaNYiKW+huGXGeBAeLHHcfq2Tfx+x3931foemtnwcXzyrOd0ESmP3VUk5ZpTWhu2L1aGOMpOaQY3+b7iIiWixDVEVrVniMWi4ZzIcKR3Rr/5H8JfkKaCEgN5iqhq/xcLEc6nLG5rTBE511yyOPnvIHlAt0p4LHZFvOkGz1FnOVgAxvuJnSFqYuQjNd+6fLMhX9+nNQE2o16yiqkJ8WFUN1cB8jQN3qGvn0='}
2023-09-02T01:25:01.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:04:36.480071', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwY+SELWkqVChTLPl8OJ29cGS++JpNb2bOGDszoi/hgRWNxn+0UAlkeXkpFyQ1Q6ZFVhTrFG18/Acq5+b29NMdDpDJbA8FTq0csD7zXta0CwbziPrjp+FTC1NwMWY6blPg8o0lz+XFG9Yp56Un95c4hLBgT8aGxTrvc0TUmO97UgX21boJHNmEUelmvyrsShzsBpCGx9xJTLRTJBHG6/zFe2PhTCJiZNZaypn0BH4S3fAFGC0pYKkau536iU6cP2/oTsxmFJ4xsIs1gexzsJWrFkAG4vHYtwcqZ44n5LMEjTm3lJ0URLfOA/ZlJPYdtugwjh/fbYDmCKsuHsdP5fM0kZcAjkq2WDXtQ7tlMVp4jPzwDIBFW09/Hww92gMX8HBOnkz3JtvDWi/m9pRdKefIPtvK/aI5IRzj6epnS0Qg3VkwFixRoT90Hh29kUTuBNWQMSpl2cY8T0qtZEVJhWqgo1Icsf5+tb7xQIQtOmsEl59PtiR09D9ca+K+M24gWaM='}
2023-09-02T01:25:01.946 INFO:teuthology.orchestra.console.smithi002:Power off
2023-09-02T01:25:01.946 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-02T01:25:01.969 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2023-09-02T01:25:01.969 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:25:01.984 INFO:teuthology.orchestra.console.smithi203:Power off
2023-09-02T01:25:01.985 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-02T01:25:01.995 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-09-02T01:25:02.007 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-09-02T01:25:02.007 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-02T01:25:02.027 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-09-02T01:25:02.097 INFO:teuthology.orchestra.console.smithi002:Power off completed
2023-09-02T01:25:02.129 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-09-02T01:25:02.244 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2023-09-02T01:25:02.278 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com