2023-10-01T17:29:44.063 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-01T17:29:44.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:29:44.209 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff62025bb50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff620d46670>, signals=[15])
2023-10-01T17:29:44.210 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2023-10-01T17:29:44.210 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2023-10-01T17:29:44.210 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2023-10-01T17:29:44.239 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging
2023-10-01T17:29:44.240 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server
2023-10-01T17:29:44.240 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2023-10-01T17:29:44.241 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /host {"name": "smithi027"}
2023-10-01T17:29:44.264 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"}
2023-10-01T17:29:44.324 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-01T17:29:44.328 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-01T17:29:44.360 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_8.stream (ID 3)
2023-10-01T17:29:44.360 DEBUG:teuthology.provision.fog.smithi027:FOG request: PUT /host/132 {"imageID": 3}
2023-10-01T17:29:44.367 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_8.stream (ID 3)
2023-10-01T17:29:44.367 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 3}
2023-10-01T17:29:44.400 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream
2023-10-01T17:29:44.401 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:29:44.406 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 8.stream
2023-10-01T17:29:44.407 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:29:44.439 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /tasktype {"name": "deploy"}
2023-10-01T17:29:44.447 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"}
2023-10-01T17:29:44.472 DEBUG:teuthology.provision.fog.smithi027:FOG request: POST /host/132/task {"taskTypeID": 1}
2023-10-01T17:29:44.483 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1}
2023-10-01T17:29:44.556 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:29:44.571 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:29:44.631 INFO:teuthology.orchestra.console.smithi027:Power off
2023-10-01T17:29:44.632 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T17:29:44.646 INFO:teuthology.orchestra.console.smithi194:Power off
2023-10-01T17:29:44.647 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T17:29:44.655 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2023-10-01T17:29:44.655 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:44.667 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2023-10-01T17:29:44.668 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:44.676 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-10-01T17:29:44.690 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-10-01T17:29:44.777 INFO:teuthology.orchestra.console.smithi027:Power off completed
2023-10-01T17:29:44.791 INFO:teuthology.orchestra.console.smithi194:Power off completed
2023-10-01T17:29:44.878 INFO:teuthology.orchestra.console.smithi027:Power on
2023-10-01T17:29:44.878 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-01T17:29:44.893 INFO:teuthology.orchestra.console.smithi194:Power on
2023-10-01T17:29:44.893 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-01T17:29:44.901 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2023-10-01T17:29:44.901 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:44.914 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On
2023-10-01T17:29:44.914 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:44.922 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-10-01T17:29:44.937 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-10-01T17:29:48.926 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:48.938 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:49.036 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-10-01T17:29:49.046 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-10-01T17:29:53.038 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:53.047 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:29:53.147 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2023-10-01T17:29:53.155 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2023-10-01T17:29:53.248 INFO:teuthology.orchestra.console.smithi027:Power on completed
2023-10-01T17:29:53.256 INFO:teuthology.orchestra.console.smithi194:Power on completed
2023-10-01T17:29:53.349 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2023-10-01T17:29:53.350 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:29:53.357 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish
2023-10-01T17:29:53.357 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:30:08.406 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:30:08.408 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:30:23.482 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:30:23.484 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:30:38.555 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:30:38.556 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:30:53.640 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:30:53.642 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:31:08.724 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:31:08.725 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:31:23.814 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:31:23.816 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:31:38.910 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:31:38.952 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:31:54.048 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:31:54.049 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:32:09.132 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:32:09.134 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:32:24.218 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:32:24.219 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-01T17:32:24.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:32:39.302 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:32:42.750 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2023-10-01T17:32:48.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:32:51.834 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2023-10-01T17:32:54.374 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:32:57.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:33:00.890 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2023-10-01T17:33:06.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:33:09.454 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-10-01T17:33:09.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:33:09.647 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: Authentication failed.
2023-10-01T17:33:09.647 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T17:33:09.647 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T17:33:09.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-10-01T17:33:09.946 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2023-10-01T17:33:10.653 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-10-01T17:33:15.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:33:19.002 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2023-10-01T17:33:25.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:34:25.006 WARNING:teuthology.provision.fog.smithi194:timed out
2023-10-01T17:34:31.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:34:31.239 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T17:34:31.239 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T17:34:31.490 INFO:teuthology.provision.fog.smithi194:Node is ready
2023-10-01T17:34:31.490 DEBUG:teuthology.orchestra.run.smithi194:> hostname
2023-10-01T17:34:31.509 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com
2023-10-01T17:34:31.510 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts
2023-10-01T17:34:31.570 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194
2023-10-01T17:34:31.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2023-10-01T17:34:31.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts
2023-10-01T17:34:31.711 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts
2023-10-01T17:34:31.780 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname
2023-10-01T17:34:31.849 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2023-10-01T17:34:31.917 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8"
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8"
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8"
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T17:34:31.975 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2023-10-01T17:34:31.976 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T17:34:31.976 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2023-10-01T17:34:31.976 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T17:34:31.976 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T17:34:31.976 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T17:34:31.977 INFO:teuthology.provision.fog.smithi194:Deploy complete!
2023-10-01T17:34:31.978 DEBUG:teuthology.parallel:result is None
2023-10-01T17:35:56.030 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-10-01T17:35:56.031 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi027
2023-10-01T17:36:05.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-10-01T17:36:05.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:36:05.252 DEBUG:teuthology.orchestra.run.smithi027:> true
2023-10-01T17:36:05.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-10-01T17:36:05.535 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T17:36:05.536 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T17:36:05.556 INFO:teuthology.provision.fog.smithi027:Node is ready
2023-10-01T17:36:05.556 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2023-10-01T17:36:05.616 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2023-10-01T17:36:05.617 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2023-10-01T17:36:05.677 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2023-10-01T17:36:05.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2023-10-01T17:36:05.792 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2023-10-01T17:36:05.823 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2023-10-01T17:36:05.893 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2023-10-01T17:36:05.962 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2023-10-01T17:36:06.031 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2023-10-01T17:36:06.089 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2023-10-01T17:36:06.089 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T17:36:06.090 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T17:36:06.091 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T17:36:06.091 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2023-10-01T17:36:06.091 DEBUG:teuthology.parallel:result is None
2023-10-01T17:36:06.270 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2023-10-01T17:36:06.271 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-01T17:36:06.296 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com
2023-10-01T17:36:06.297 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-01T17:36:06.322 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2023-10-01T17:36:06.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-10-01T17:36:06.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:36:06.388 DEBUG:teuthology.orchestra.run.smithi027:> true
2023-10-01T17:36:06.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-10-01T17:36:06.460 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2023-10-01T17:36:06.518 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2023-10-01T17:36:06.518 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2023-10-01T17:36:06.576 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2023-10-01T17:36:06.576 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2023-10-01T17:36:06.576 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2023-10-01T17:36:06.576 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2023-10-01T17:36:06.576 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2023-10-01T17:36:06.577 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2023-10-01T17:36:06.577 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T17:36:06.577 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2023-10-01T17:36:06.577 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T17:36:06.577 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2023-10-01T17:36:06.577 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T17:36:06.578 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T17:36:06.578 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T17:36:06.578 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2023-10-01T17:36:06.597 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server
2023-10-01T17:36:06.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-10-01T17:36:06.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T17:36:06.666 DEBUG:teuthology.orchestra.run.smithi194:> true
2023-10-01T17:36:06.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-10-01T17:36:06.740 DEBUG:teuthology.orchestra.run.smithi194:> uname -m
2023-10-01T17:36:06.800 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64
2023-10-01T17:36:06.800 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2023-10-01T17:36:06.863 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2023-10-01T17:36:06.864 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T17:36:06.865 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T17:36:06.865 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T17:36:06.865 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2023-10-01T17:36:06.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:36:06.983 INFO:teuthology.dispatcher.supervisor:Running job 7408302
2023-10-01T17:36:06.983 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408302 --name yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408302/orig.config.yaml
2023-10-01T17:36:06.986 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408302
2023-10-01T17:36:06.987 INFO:teuthology.dispatcher.supervisor:Job PID: 2363094
2023-10-01T17:36:06.987 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-01T17:38:07.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:40:07.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:42:07.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:44:07.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:46:07.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:48:07.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:50:08.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:52:08.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:54:08.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:56:08.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:58:08.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:58:08.749 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-01T17:58:08.869 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-01T17:58:08.870 INFO:teuthology.nuke:Checking targets against current locks
2023-10-01T17:58:08.920 DEBUG:teuthology.nuke:shortname: smithi027
2023-10-01T17:58:08.920 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-01T17:58:08.944 DEBUG:teuthology.nuke:shortname: smithi194
2023-10-01T17:58:08.945 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-01T17:58:08.946 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408302', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 17:29:43.218179', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFU83RChgGWPGRirmRcOvEDX054JWK8oYVFloEucqI/O600DYx4n5kvSYvmfv48wJh8DHvBpw/3NvEWmh1UfstY='}
2023-10-01T17:58:08.969 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408302', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 17:29:43.219900', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJNl/b27Jg/KyyjPBe4+MsmxcT3mIynIGfJsBVMREHK21Qj48G1i+nyPKDGgmT2cqTsTJRv25TVkGlr05k4Its8='}
2023-10-01T17:58:08.997 INFO:teuthology.orchestra.console.smithi027:Power off
2023-10-01T17:58:08.998 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T17:58:09.022 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2023-10-01T17:58:09.025 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:58:09.046 INFO:teuthology.orchestra.console.smithi194:Power off
2023-10-01T17:58:09.047 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T17:58:09.056 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-10-01T17:58:09.070 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2023-10-01T17:58:09.071 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:58:09.093 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-10-01T17:58:09.158 INFO:teuthology.orchestra.console.smithi027:Power off completed
2023-10-01T17:58:09.194 INFO:teuthology.orchestra.console.smithi194:Power off completed
2023-10-01T17:58:09.307 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2023-10-01T17:58:09.340 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com