2023-08-17T11:38:09.858 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-17T11:38:09.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:38:10.014 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f255bfea7c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f255d214310>, signals=[15])
2023-08-17T11:38:10.016 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging
2023-08-17T11:38:10.016 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server
2023-08-17T11:38:10.017 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2023-08-17T11:38:10.040 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2023-08-17T11:38:10.041 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2023-08-17T11:38:10.042 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-08-17T11:38:10.045 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /host {"name": "smithi053"}
2023-08-17T11:38:10.065 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"}
2023-08-17T11:38:10.120 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-17T11:38:10.135 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-17T11:38:10.163 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_8.stream (ID 3)
2023-08-17T11:38:10.163 DEBUG:teuthology.provision.fog.smithi053:FOG request: PUT /host/158 {"imageID": 3}
2023-08-17T11:38:10.185 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3)
2023-08-17T11:38:10.186 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 3}
2023-08-17T11:38:10.227 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 8.stream
2023-08-17T11:38:10.227 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:38:10.232 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream
2023-08-17T11:38:10.232 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:38:10.283 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /tasktype {"name": "deploy"}
2023-08-17T11:38:10.285 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"}
2023-08-17T11:38:10.317 DEBUG:teuthology.provision.fog.smithi053:FOG request: POST /host/158/task {"taskTypeID": 1}
2023-08-17T11:38:10.328 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1}
2023-08-17T11:38:10.366 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:38:10.383 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:38:10.453 INFO:teuthology.orchestra.console.smithi053:Power off
2023-08-17T11:38:10.454 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T11:38:10.475 INFO:teuthology.orchestra.console.smithi169:Power off
2023-08-17T11:38:10.476 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T11:38:10.486 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2023-08-17T11:38:10.487 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:10.499 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-08-17T11:38:10.500 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:10.509 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2023-08-17T11:38:10.521 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-17T11:38:14.512 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:14.521 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:14.623 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2023-08-17T11:38:14.632 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-17T11:38:18.628 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:18.639 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:18.742 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-08-17T11:38:18.753 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-17T11:38:18.843 INFO:teuthology.orchestra.console.smithi053:Power off completed
2023-08-17T11:38:18.855 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-08-17T11:38:18.945 INFO:teuthology.orchestra.console.smithi053:Power on
2023-08-17T11:38:18.946 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-17T11:38:18.956 INFO:teuthology.orchestra.console.smithi169:Power on
2023-08-17T11:38:18.957 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-17T11:38:18.969 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On
2023-08-17T11:38:18.970 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:18.983 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2023-08-17T11:38:18.984 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:18.996 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-08-17T11:38:19.006 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-17T11:38:23.000 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:23.009 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:23.111 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-08-17T11:38:23.120 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-17T11:38:27.116 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:27.126 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T11:38:27.229 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2023-08-17T11:38:27.237 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-17T11:38:27.331 INFO:teuthology.orchestra.console.smithi053:Power on completed
2023-08-17T11:38:27.338 INFO:teuthology.orchestra.console.smithi169:Power on completed
2023-08-17T11:38:27.433 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish
2023-08-17T11:38:27.434 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:38:27.440 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2023-08-17T11:38:27.440 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:38:42.516 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:38:42.525 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:38:57.588 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:38:57.605 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:39:12.682 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:39:12.685 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:39:27.780 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:39:27.781 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:39:42.884 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:39:42.885 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:39:57.996 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:39:57.997 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:40:13.100 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:40:13.101 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:40:28.212 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:40:28.213 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:40:43.316 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:40:43.317 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:40:58.404 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:40:58.411 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None
2023-08-17T11:40:58.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:41:01.552 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-08-17T11:41:07.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:41:10.608 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-08-17T11:41:13.494 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-17T11:41:13.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:41:13.650 ERROR:teuthology.orchestra.connection:Error authenticating with smithi169.front.sepia.ceph.com: Authentication failed.
2023-08-17T11:41:13.651 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T11:41:13.653 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T11:41:13.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-17T11:41:16.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:41:19.664 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-08-17T11:41:25.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:41:28.720 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-08-17T11:41:34.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:41:37.776 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-08-17T11:41:43.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:42:43.780 WARNING:teuthology.provision.fog.smithi053:timed out
2023-08-17T11:42:49.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:42:50.147 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T11:42:50.148 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T11:42:50.382 INFO:teuthology.provision.fog.smithi053:Node is ready
2023-08-17T11:42:50.382 DEBUG:teuthology.orchestra.run.smithi053:> hostname
2023-08-17T11:42:50.402 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com
2023-08-17T11:42:50.403 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts
2023-08-17T11:42:50.463 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053
2023-08-17T11:42:50.463 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2023-08-17T11:42:50.663 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts
2023-08-17T11:42:50.695 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts
2023-08-17T11:42:50.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname
2023-08-17T11:42:50.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2023-08-17T11:42:50.905 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2023-08-17T11:42:50.964 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2023-08-17T11:42:50.964 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8"
2023-08-17T11:42:50.965 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2023-08-17T11:42:50.965 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2023-08-17T11:42:50.965 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8"
2023-08-17T11:42:50.965 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8"
2023-08-17T11:42:50.965 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-17T11:42:50.966 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2023-08-17T11:42:50.966 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-17T11:42:50.966 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2023-08-17T11:42:50.966 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T11:42:50.966 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T11:42:50.966 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-17T11:42:50.967 INFO:teuthology.provision.fog.smithi053:Deploy complete!
2023-08-17T11:42:50.968 DEBUG:teuthology.parallel:result is None
2023-08-17T11:43:04.816 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-08-17T11:43:04.817 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi169
2023-08-17T11:43:13.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-17T11:43:13.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:43:14.020 DEBUG:teuthology.orchestra.run.smithi169:> true
2023-08-17T11:43:14.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-17T11:43:14.296 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T11:43:14.297 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T11:43:29.321 INFO:teuthology.provision.fog.smithi169:Node is ready
2023-08-17T11:43:29.322 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2023-08-17T11:43:29.347 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2023-08-17T11:43:29.347 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2023-08-17T11:43:29.408 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2023-08-17T11:43:29.409 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-08-17T11:43:29.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2023-08-17T11:43:29.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2023-08-17T11:43:29.644 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2023-08-17T11:43:29.714 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-08-17T11:43:29.783 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-08-17T11:43:29.841 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2023-08-17T11:43:29.842 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2023-08-17T11:43:29.842 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2023-08-17T11:43:29.842 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2023-08-17T11:43:29.842 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2023-08-17T11:43:29.842 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-08-17T11:43:29.842 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-17T11:43:29.843 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-08-17T11:43:29.843 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-17T11:43:29.843 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2023-08-17T11:43:29.843 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T11:43:29.843 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T11:43:29.843 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-17T11:43:29.843 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2023-08-17T11:43:29.844 DEBUG:teuthology.parallel:result is None
2023-08-17T11:43:30.026 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com
2023-08-17T11:43:30.027 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-17T11:43:30.048 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2023-08-17T11:43:30.048 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-17T11:43:30.067 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server
2023-08-17T11:43:30.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2023-08-17T11:43:30.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:43:30.141 DEBUG:teuthology.orchestra.run.smithi053:> true
2023-08-17T11:43:30.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com'
2023-08-17T11:43:30.281 DEBUG:teuthology.orchestra.run.smithi053:> uname -m
2023-08-17T11:43:30.341 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64
2023-08-17T11:43:30.342 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2023-08-17T11:43:30.401 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2023-08-17T11:43:30.402 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8"
2023-08-17T11:43:30.402 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2023-08-17T11:43:30.402 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2023-08-17T11:43:30.404 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8"
2023-08-17T11:43:30.404 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8"
2023-08-17T11:43:30.404 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-17T11:43:30.404 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2023-08-17T11:43:30.405 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-17T11:43:30.405 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2023-08-17T11:43:30.405 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T11:43:30.405 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T11:43:30.405 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-17T11:43:30.406 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2023-08-17T11:43:30.423 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2023-08-17T11:43:30.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-17T11:43:30.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T11:43:30.489 DEBUG:teuthology.orchestra.run.smithi169:> true
2023-08-17T11:43:30.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-17T11:43:30.561 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2023-08-17T11:43:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2023-08-17T11:43:30.622 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-08-17T11:43:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2023-08-17T11:43:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2023-08-17T11:43:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2023-08-17T11:43:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2023-08-17T11:43:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2023-08-17T11:43:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-08-17T11:43:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-17T11:43:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-08-17T11:43:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-17T11:43:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2023-08-17T11:43:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T11:43:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T11:43:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-17T11:43:30.683 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-08-17T11:43:30.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:43:30.806 INFO:teuthology.dispatcher.supervisor:Running job 7371392
2023-08-17T11:43:30.807 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-16_22:40:18-rados-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371392 --name yuriw-2023-08-16_22:40:18-rados-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-08-16_22:40:18-rados-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371392/orig.config.yaml
2023-08-17T11:43:30.810 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-16_22:40:18-rados-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371392
2023-08-17T11:43:30.811 INFO:teuthology.dispatcher.supervisor:Job PID: 2335
2023-08-17T11:43:30.811 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-17T11:45:30.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:47:31.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:49:31.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:51:31.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:53:31.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:55:31.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:57:31.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T11:59:32.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:01:32.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:03:32.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:05:32.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:07:32.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:09:32.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:11:33.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:13:33.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:15:33.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:17:33.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:19:33.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:21:33.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:23:34.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:25:34.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:27:34.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:29:34.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:31:34.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:33:35.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:35:35.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:37:35.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T12:37:35.452 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-17T12:37:35.640 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-17T12:37:35.640 INFO:teuthology.nuke:Checking targets against current locks
2023-08-17T12:37:35.687 DEBUG:teuthology.nuke:shortname: smithi053
2023-08-17T12:37:35.688 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-17T12:37:35.710 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-16_22:40:18-rados-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371392', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 11:38:08.959084', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChZH+7B3xRWevWtLYvft4l7xPblYd4eepZLy8zALelnhrbkKAK+uQVbB3sbUvUjyKR2WWbBOHZVZhMLfFTY/pPIRdZWfld45XAoxcZsE5oKcirtCLS7ydUkd1SjmZrraqAA9+slcVCNqfFfqgZSbpwKOYikDREskSMPlkC8m/dUz8XL98TQ/ux9gva8EjTHNINlw9adYsYcWq3oTMr2wbYVn/Yt85d4H2V+ZDx5KaPKCVQkBbbld/znxYU+5K5yGS8P/JFRr7aGm0u97zGN2/yfER9uLYo1B8LfmX6IESiyUtULipA9+azv7IcovDI1hGfBNAc0RT3FwTpLXZIPo4+xoQQMrdchyIfid5hzBkgQ7pikqjSkUzV70x8LqCReULOFNkLE0EeGM3duv6f2TOzYkqR/wnstosRZL+uFHsi3jlSvaIB4EcDbGJD/c8ilbrlfWObeiPh6SkcDqeshmokHVsq4H6CByO26eDUrh7MDH2dRNakvakgiv1FtTuMX7U='}
2023-08-17T12:37:35.713 DEBUG:teuthology.nuke:shortname: smithi169
2023-08-17T12:37:35.713 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-17T12:37:35.737 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-16_22:40:18-rados-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371392', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 11:38:08.960784', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4jdjWCPec+FI1wam1Waq/XFyWi7+rU0+fNCqyekyXz8eE/+lGkXO9slhwcDlms6IUX+T9X3lp5705oKwfj+38='}
2023-08-17T12:37:35.764 INFO:teuthology.orchestra.console.smithi053:Power off
2023-08-17T12:37:35.765 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T12:37:35.782 INFO:teuthology.orchestra.console.smithi169:Power off
2023-08-17T12:37:35.783 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T12:37:35.793 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2023-08-17T12:37:35.795 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T12:37:35.807 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-08-17T12:37:35.808 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T12:37:35.822 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-08-17T12:37:35.845 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-17T12:37:35.924 INFO:teuthology.orchestra.console.smithi053:Power off completed
2023-08-17T12:37:35.947 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-08-17T12:37:36.076 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com
2023-08-17T12:37:36.100 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com