2023-08-30T23:23:40.136 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T23:23:40.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:23:40.306 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5b3c118670>, signals=[15]) 2023-08-30T23:23:40.308 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-08-30T23:23:40.312 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T23:23:40.312 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-08-30T23:23:40.336 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-08-30T23:23:40.337 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T23:23:40.337 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-08-30T23:23:40.339 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-08-30T23:23:40.368 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-08-30T23:23:40.420 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T23:23:40.446 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T23:23:40.463 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T23:23:40.463 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 3} 2023-08-30T23:23:40.496 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T23:23:40.496 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 3} 2023-08-30T23:23:40.516 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.stream 2023-08-30T23:23:40.517 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:23:40.549 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream 2023-08-30T23:23:40.549 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:23:40.569 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T23:23:40.601 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T23:23:40.618 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-08-30T23:23:40.640 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-08-30T23:23:40.668 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:23:40.693 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:23:40.782 INFO:teuthology.orchestra.console.smithi114:Power off 2023-08-30T23:23:40.783 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:23:40.799 INFO:teuthology.orchestra.console.smithi125:Power off 2023-08-30T23:23:40.799 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:23:40.808 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-08-30T23:23:40.809 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:23:40.819 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-08-30T23:23:40.819 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:23:40.833 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-08-30T23:23:40.843 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-08-30T23:23:40.934 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-08-30T23:23:40.945 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-08-30T23:23:41.035 INFO:teuthology.orchestra.console.smithi114:Power on 2023-08-30T23:23:41.036 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T23:23:41.047 INFO:teuthology.orchestra.console.smithi125:Power on 2023-08-30T23:23:41.048 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T23:23:41.058 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2023-08-30T23:23:41.059 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:23:41.072 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-08-30T23:23:41.072 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:23:41.083 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-08-30T23:23:41.097 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-08-30T23:23:45.089 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:23:45.099 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:23:45.200 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-08-30T23:23:45.211 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-08-30T23:23:45.312 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-08-30T23:23:45.414 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-08-30T23:23:45.414 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:23:49.202 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:23:49.311 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-08-30T23:23:49.412 INFO:teuthology.orchestra.console.smithi114:Power on completed 2023-08-30T23:23:49.513 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-08-30T23:23:49.514 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:24:00.498 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:24:04.590 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:24:15.570 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:24:19.650 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:24:30.658 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:24:34.731 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:24:45.740 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:24:49.812 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:25:00.834 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:25:04.902 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:25:15.926 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:25:19.982 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:25:31.023 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:25:35.063 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:25:46.126 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:25:50.158 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:26:01.243 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:26:05.248 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:26:16.354 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:26:20.374 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-30T23:26:20.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:26:31.454 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-08-30T23:26:31.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:26:34.651 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-08-30T23:26:40.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:26:43.712 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-08-30T23:26:49.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:26:52.794 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-08-30T23:26:58.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:27:01.850 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-08-30T23:27:07.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:27:10.910 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-08-30T23:27:16.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:27:19.962 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-08-30T23:27:20.761 ERROR:teuthology.orchestra.connection:Error authenticating with smithi114.front.sepia.ceph.com: Authentication timeout. 2023-08-30T23:27:20.762 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T23:27:20.763 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T23:27:25.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:28:25.966 WARNING:teuthology.provision.fog.smithi125:timed out 2023-08-30T23:28:31.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:28:32.197 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T23:28:32.197 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T23:28:32.457 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-08-30T23:28:32.457 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-08-30T23:28:32.476 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-08-30T23:28:32.476 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-08-30T23:28:32.534 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-08-30T23:28:32.535 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-08-30T23:28:32.625 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-08-30T23:28:32.654 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-08-30T23:28:32.723 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-08-30T23:28:32.791 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-08-30T23:28:32.857 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-08-30T23:28:32.916 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-08-30T23:28:32.916 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-08-30T23:28:32.916 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-08-30T23:28:32.917 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:28:32.917 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-08-30T23:28:32.917 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:28:32.917 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:28:32.917 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-08-30T23:28:32.918 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:28:32.918 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:28:32.918 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:28:32.918 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:28:32.918 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:28:32.919 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-08-30T23:28:32.920 DEBUG:teuthology.parallel:result is None 2023-08-30T23:28:44.442 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-30T23:28:44.443 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi114 2023-08-30T23:28:53.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-08-30T23:28:53.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:28:53.690 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-08-30T23:28:53.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-08-30T23:28:53.967 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T23:28:53.967 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T23:28:53.988 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-08-30T23:28:53.988 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-08-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2023-08-30T23:28:54.049 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2023-08-30T23:28:54.109 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-08-30T23:28:54.109 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-08-30T23:28:54.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2023-08-30T23:28:54.252 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2023-08-30T23:28:54.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2023-08-30T23:28:54.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-08-30T23:28:54.466 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-08-30T23:28:54.525 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-08-30T23:28:54.525 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2023-08-30T23:28:54.525 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-08-30T23:28:54.525 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:28:54.526 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2023-08-30T23:28:54.526 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:28:54.526 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:28:54.526 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-08-30T23:28:54.526 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:28:54.527 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:28:54.527 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:28:54.527 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:28:54.527 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:28:54.528 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-08-30T23:28:54.529 DEBUG:teuthology.parallel:result is None 2023-08-30T23:28:54.686 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-08-30T23:28:54.687 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T23:28:54.721 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-08-30T23:28:54.721 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T23:28:54.748 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-08-30T23:28:54.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-08-30T23:28:54.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:28:54.815 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-08-30T23:28:54.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-08-30T23:28:54.840 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-08-30T23:28:54.898 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-08-30T23:28:54.899 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-08-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-08-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2023-08-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-08-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:28:54.959 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2023-08-30T23:28:54.959 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:28:54.959 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:28:54.959 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-08-30T23:28:54.959 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:28:54.960 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:28:54.960 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:28:54.960 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:28:54.960 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:28:54.961 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-08-30T23:28:54.979 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-08-30T23:28:54.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-08-30T23:28:54.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:28:55.049 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-08-30T23:28:55.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-08-30T23:28:55.191 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-08-30T23:28:55.251 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-08-30T23:28:55.251 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-08-30T23:28:55.310 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-08-30T23:28:55.310 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-08-30T23:28:55.311 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-08-30T23:28:55.311 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:28:55.311 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-08-30T23:28:55.311 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:28:55.311 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:28:55.312 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-08-30T23:28:55.312 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:28:55.312 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:28:55.312 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:28:55.312 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:28:55.312 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:28:55.313 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-08-30T23:28:55.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:28:55.436 INFO:teuthology.dispatcher.supervisor:Running job 7384917 2023-08-30T23:28:55.437 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384917 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384917/orig.config.yaml 2023-08-30T23:28:55.442 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384917 2023-08-30T23:28:55.442 INFO:teuthology.dispatcher.supervisor:Job PID: 4110151 2023-08-30T23:28:55.443 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T23:30:55.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:32:55.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:34:55.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:36:56.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:38:56.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:40:56.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:42:56.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:44:56.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:44:56.757 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T23:44:56.870 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T23:44:56.871 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T23:44:56.920 DEBUG:teuthology.nuke:shortname: smithi114 2023-08-30T23:44:56.921 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:44:56.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384917', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 23:23:39.221141', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ4UnZSqDHWUOl0f2H0t2NmHncX7RhN+OAKYKBzzOtMhdR2OjNhE7c8bKIPlBS3qwrRc98rEbf4eG7KA8w1IL+8='} 2023-08-30T23:44:56.944 DEBUG:teuthology.nuke:shortname: smithi125 2023-08-30T23:44:56.944 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:44:56.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384917', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 23:23:39.223052', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMp0zbRgzzFGZvp4hy2pWURY2eI4IR2W8XO3HRirmmkcTYGKiklRtqRcEIpsUb9r5g4hm1MTbLNYKQqWIJQ7wg8='} 2023-08-30T23:44:56.994 INFO:teuthology.orchestra.console.smithi114:Power off 2023-08-30T23:44:56.995 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:44:57.018 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-08-30T23:44:57.019 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:44:57.033 INFO:teuthology.orchestra.console.smithi125:Power off 2023-08-30T23:44:57.034 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:44:57.044 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-08-30T23:44:57.056 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-08-30T23:44:57.057 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:44:57.079 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-08-30T23:44:57.145 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-08-30T23:44:57.181 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-08-30T23:44:57.297 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2023-08-30T23:44:57.330 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com