2023-09-05T12:05:13.908 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-05T12:05:13.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:05:14.066 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1cd7378b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1cd7027f70>, signals=[15])
2023-09-05T12:05:14.067 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging
2023-09-05T12:05:14.068 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server
2023-09-05T12:05:14.068 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2023-09-05T12:05:14.095 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging
2023-09-05T12:05:14.096 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server
2023-09-05T12:05:14.096 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-09-05T12:05:14.097 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"}
2023-09-05T12:05:14.119 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"}
2023-09-05T12:05:14.164 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-05T12:05:14.188 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-05T12:05:14.207 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_8.stream (ID 3)
2023-09-05T12:05:14.207 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 3}
2023-09-05T12:05:14.229 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_8.stream (ID 3)
2023-09-05T12:05:14.230 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 3}
2023-09-05T12:05:14.250 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 8.stream
2023-09-05T12:05:14.250 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:05:14.274 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream
2023-09-05T12:05:14.274 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:05:14.325 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"}
2023-09-05T12:05:14.346 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"}
2023-09-05T12:05:14.364 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1}
2023-09-05T12:05:14.393 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1}
2023-09-05T12:05:14.411 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:05:14.454 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:05:14.528 INFO:teuthology.orchestra.console.smithi059:Power off
2023-09-05T12:05:14.529 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:05:14.550 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2023-09-05T12:05:14.550 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:05:14.571 INFO:teuthology.orchestra.console.smithi125:Power off
2023-09-05T12:05:14.571 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:05:14.579 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2023-09-05T12:05:14.591 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-09-05T12:05:14.591 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:05:14.614 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-09-05T12:05:14.680 INFO:teuthology.orchestra.console.smithi059:Power off completed
2023-09-05T12:05:14.716 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-09-05T12:05:14.782 INFO:teuthology.orchestra.console.smithi059:Power on
2023-09-05T12:05:14.782 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-05T12:05:14.803 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On
2023-09-05T12:05:14.804 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:05:14.817 INFO:teuthology.orchestra.console.smithi125:Power on
2023-09-05T12:05:14.818 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-05T12:05:14.828 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2023-09-05T12:05:14.838 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On
2023-09-05T12:05:14.838 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:05:14.858 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-09-05T12:05:18.830 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:05:18.859 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:05:18.939 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2023-09-05T12:05:18.969 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-09-05T12:05:19.069 INFO:teuthology.orchestra.console.smithi125:Power on completed
2023-09-05T12:05:19.170 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2023-09-05T12:05:19.171 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:05:22.943 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:05:23.172 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2023-09-05T12:05:23.273 INFO:teuthology.orchestra.console.smithi059:Power on completed
2023-09-05T12:05:23.374 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2023-09-05T12:05:23.374 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:05:34.284 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:05:38.458 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:05:49.377 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:05:53.542 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:06:15.566 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:06:15.572 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:06:30.962 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:06:30.983 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:06:46.178 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:06:46.190 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:07:01.332 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:07:01.334 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:07:16.506 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:07:16.526 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:07:31.662 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:07:31.675 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:07:46.782 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:07:46.784 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-05T12:07:46.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:07:47.026 ERROR:teuthology.orchestra.connection:Error authenticating with smithi059.front.sepia.ceph.com: Authentication failed.
2023-09-05T12:07:47.028 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-05T12:07:47.029 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-05T12:07:47.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-05T12:08:01.895 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-09-05T12:08:01.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:08:05.050 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:08:11.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:08:14.110 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:08:20.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:08:23.166 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:08:29.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:08:32.222 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:08:38.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:08:41.278 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:08:47.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:08:50.334 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:08:56.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:14.650 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:09:20.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:23.706 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-09-05T12:09:29.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:30.581 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-05T12:09:30.581 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-05T12:09:39.482 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-09-05T12:09:39.483 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi059
2023-09-05T12:09:48.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2023-09-05T12:09:48.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:48.721 DEBUG:teuthology.orchestra.run.smithi059:> true
2023-09-05T12:09:48.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com'
2023-09-05T12:09:49.042 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-05T12:09:49.042 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-05T12:09:49.063 INFO:teuthology.provision.fog.smithi059:Node is ready
2023-09-05T12:09:49.064 DEBUG:teuthology.orchestra.run.smithi059:> hostname
2023-09-05T12:09:49.125 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2023-09-05T12:09:49.126 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts
2023-09-05T12:09:49.187 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2023-09-05T12:09:49.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2023-09-05T12:09:49.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts
2023-09-05T12:09:49.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts
2023-09-05T12:09:49.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname
2023-09-05T12:09:49.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2023-09-05T12:09:49.546 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2023-09-05T12:09:49.605 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2023-09-05T12:09:49.605 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8"
2023-09-05T12:09:49.606 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2023-09-05T12:09:49.606 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:09:49.606 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8"
2023-09-05T12:09:49.606 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2023-09-05T12:09:49.606 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-05T12:09:49.607 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2023-09-05T12:09:49.607 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-05T12:09:49.607 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:09:49.607 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:09:49.607 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-05T12:09:49.608 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:09:49.608 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2023-09-05T12:09:49.609 DEBUG:teuthology.parallel:result is None
2023-09-05T12:09:56.052 INFO:teuthology.provision.fog.smithi125:Node is ready
2023-09-05T12:09:56.052 DEBUG:teuthology.orchestra.run.smithi125:> hostname
2023-09-05T12:09:56.077 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2023-09-05T12:09:56.077 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts
2023-09-05T12:09:56.139 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2023-09-05T12:09:56.139 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-09-05T12:09:56.263 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts
2023-09-05T12:09:56.298 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts
2023-09-05T12:09:56.372 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname
2023-09-05T12:09:56.446 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-09-05T12:09:56.520 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-09-05T12:09:56.581 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2023-09-05T12:09:56.582 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8"
2023-09-05T12:09:56.582 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2023-09-05T12:09:56.582 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:09:56.582 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8"
2023-09-05T12:09:56.583 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8"
2023-09-05T12:09:56.583 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-05T12:09:56.583 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2023-09-05T12:09:56.583 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-05T12:09:56.583 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:09:56.584 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:09:56.584 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-05T12:09:56.584 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:09:56.584 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2023-09-05T12:09:56.585 DEBUG:teuthology.parallel:result is None
2023-09-05T12:09:56.741 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2023-09-05T12:09:56.742 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-05T12:09:56.774 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2023-09-05T12:09:56.775 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-05T12:09:56.792 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2023-09-05T12:09:56.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2023-09-05T12:09:56.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:56.861 DEBUG:teuthology.orchestra.run.smithi059:> true
2023-09-05T12:09:56.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com'
2023-09-05T12:09:56.935 DEBUG:teuthology.orchestra.run.smithi059:> uname -m
2023-09-05T12:09:56.994 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2023-09-05T12:09:56.995 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2023-09-05T12:09:57.054 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2023-09-05T12:09:57.055 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8"
2023-09-05T12:09:57.055 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2023-09-05T12:09:57.055 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:09:57.055 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8"
2023-09-05T12:09:57.056 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2023-09-05T12:09:57.056 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-05T12:09:57.056 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2023-09-05T12:09:57.056 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-05T12:09:57.056 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:09:57.057 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:09:57.057 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-05T12:09:57.057 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:09:57.058 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2023-09-05T12:09:57.082 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2023-09-05T12:09:57.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-09-05T12:09:57.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:57.151 DEBUG:teuthology.orchestra.run.smithi125:> true
2023-09-05T12:09:57.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-09-05T12:09:57.224 DEBUG:teuthology.orchestra.run.smithi125:> uname -m
2023-09-05T12:09:57.285 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2023-09-05T12:09:57.286 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-09-05T12:09:57.347 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2023-09-05T12:09:57.347 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8"
2023-09-05T12:09:57.347 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2023-09-05T12:09:57.348 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:09:57.348 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8"
2023-09-05T12:09:57.348 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8"
2023-09-05T12:09:57.348 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-05T12:09:57.348 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2023-09-05T12:09:57.349 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-05T12:09:57.349 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:09:57.349 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:09:57.349 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-05T12:09:57.349 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:09:57.350 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-09-05T12:09:57.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:09:57.469 INFO:teuthology.dispatcher.supervisor:Running job 7388279
2023-09-05T12:09:57.470 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388279 --name mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388279/orig.config.yaml
2023-09-05T12:09:57.473 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388279
2023-09-05T12:09:57.473 INFO:teuthology.dispatcher.supervisor:Job PID: 3972499
2023-09-05T12:09:57.474 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-05T12:11:57.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:13:57.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:15:57.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:17:58.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:19:58.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:21:58.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:23:58.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:25:58.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:27:58.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:29:59.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:31:59.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:33:59.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:33:59.522 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-05T12:33:59.708 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-05T12:33:59.709 INFO:teuthology.nuke:Checking targets against current locks
2023-09-05T12:33:59.761 DEBUG:teuthology.nuke:shortname: smithi059
2023-09-05T12:33:59.761 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-05T12:33:59.785 DEBUG:teuthology.nuke:shortname: smithi125
2023-09-05T12:33:59.785 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-05T12:33:59.789 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 12:05:13.061135', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO2xJtydtQAl8xOizfnP8oKfqNATIMNv4EG/oS0d+BkMqvHCj1Mcw5McoHhkAm5nUWpVkFAK4IkgBA7X1fhgS5Lvz1JDWuNNnwwTIZ8NktpepUNSHbbJTEIuAKQM4uv/1t14Pv3L3ZXtveWbGe3+Dt0QfOL0kO+lVJSSs5AHQowdSvmVJLH6OsCgCoxvXMB6gzoFjXVWGzcGJDCaRn1MJ9nojz23TgHtJ3OUeLUQiX9c/ZgJQKDQydBjsXr9CMK7iL/OHcB2NogyZ7aWt5H+NSwClnwc37QQUztdZFNEZVPR2CC9ZxL+3YzHSiqgDmS0TBQqiMkzAII2nKKlXY3z0cg/TsbafyoIGt7/rVeel32ZHq8H06rx9izgDAfd9fCQq7Tev5xQIC9Ejq4BZwc/w5Jg4CvwkqzBiywBbCGp58YiX9sgPeoyG6ma//FM0skO1w1YGNxB2EJ2aaTl6T7koTN0M8YMloxm+WCrEw1376OcSg1OkhYH6iACzm8bSq4O8='}
2023-09-05T12:33:59.811 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 12:05:13.063124', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5qKYQk5TToNieqf1ugHGAipMXerAQ8FB39HFkzecZPdrOc2uDOfHyx7IaOnBlTl8aiwzoBJM9RLSfIwzPhRM109V2+S7Oz98xPMOsS6j2RjlYrQ9O81yn6Yv1Rrzb1bT0OMzUOVobsmhPYuDtKXBxh73wkGDyiP8E8YIVkyyuisXvbh9O/tJEv3k+9FyIhsLctGgNaCdJHVCVeFthmScxGOk9GoI6WbiaizJKVSqiabJIhrnFZRErZuMEI+hjvTo06TxizLmC3WdLcT2AtbL35yb22qdYDWTmyzy/CejM7eK2TXEVbb8ILnOE4R0CtNMihrBRdzUiqjgswhROy+loKkIgxA5dLNPecRarS9CX8bUSq+EuED5iZdvbYYWRkWT5HGrweXNY51/CFuPTPsW4mcp7Iz550btxoX26Oo9FZUQ+Uxhg+KpurZY3LY5YHV8caNBjr4dQusVbubE/ZgDkUcDluaZfizzbvgtaWuw/o8Wbw2cZmx1IP98dtuNCkpk='}
2023-09-05T12:33:59.844 INFO:teuthology.orchestra.console.smithi059:Power off
2023-09-05T12:33:59.844 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:33:59.870 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2023-09-05T12:33:59.871 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:33:59.885 INFO:teuthology.orchestra.console.smithi125:Power off
2023-09-05T12:33:59.885 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:33:59.894 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2023-09-05T12:33:59.905 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-09-05T12:33:59.905 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:33:59.926 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-09-05T12:33:59.996 INFO:teuthology.orchestra.console.smithi059:Power off completed
2023-09-05T12:34:00.028 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-09-05T12:34:00.145 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com
2023-09-05T12:34:00.171 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com