2023-10-21T12:02:52.909 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T12:02:52.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T12:02:53.041 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe9367c5670>, signals=[15]) 2023-10-21T12:02:53.043 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2023-10-21T12:02:53.043 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T12:02:53.043 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-10-21T12:02:53.062 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-10-21T12:02:53.062 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T12:02:53.063 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-21T12:02:53.064 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /host {"name": "smithi071"} 2023-10-21T12:02:53.087 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-10-21T12:02:53.158 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T12:02:53.161 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T12:02:53.198 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T12:02:53.199 DEBUG:teuthology.provision.fog.smithi071:FOG request: PUT /host/176 {"imageID": 3} 2023-10-21T12:02:53.206 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T12:02:53.206 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 3} 2023-10-21T12:02:53.245 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.stream 2023-10-21T12:02:53.245 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:02:53.254 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream 2023-10-21T12:02:53.255 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:02:53.307 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T12:02:53.319 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T12:02:53.352 DEBUG:teuthology.provision.fog.smithi071:FOG request: POST /host/176/task {"taskTypeID": 1} 2023-10-21T12:02:53.355 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-10-21T12:02:53.409 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:02:53.412 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:02:53.535 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-21T12:02:53.536 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T12:02:53.548 INFO:teuthology.orchestra.console.smithi071:Power off 2023-10-21T12:02:53.549 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T12:02:53.557 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-21T12:02:53.558 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:02:53.569 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-10-21T12:02:53.570 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:02:53.579 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-21T12:02:53.592 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-21T12:02:57.582 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:02:57.593 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:02:57.692 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-21T12:02:57.701 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-21T12:03:01.694 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:01.702 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:01.802 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-21T12:03:01.811 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-10-21T12:03:01.912 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-10-21T12:03:02.013 INFO:teuthology.orchestra.console.smithi071:Power on 2023-10-21T12:03:02.013 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T12:03:02.034 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2023-10-21T12:03:02.035 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:02.055 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-10-21T12:03:05.805 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:05.913 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-21T12:03:06.014 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-21T12:03:06.056 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:06.116 INFO:teuthology.orchestra.console.smithi192:Power on 2023-10-21T12:03:06.117 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T12:03:06.138 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-10-21T12:03:06.138 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:06.159 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-21T12:03:06.165 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-10-21T12:03:10.162 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:10.169 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:10.272 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-21T12:03:10.302 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-21T12:03:10.403 INFO:teuthology.orchestra.console.smithi071:Power on completed 2023-10-21T12:03:10.504 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2023-10-21T12:03:10.504 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:03:14.275 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:03:14.383 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-21T12:03:14.484 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-10-21T12:03:14.585 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-10-21T12:03:14.586 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:03:25.594 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:03:29.662 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:03:40.678 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:03:44.748 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:03:55.770 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:03:59.818 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:04:10.855 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:04:14.890 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:04:25.929 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:04:29.966 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:04:41.010 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:04:45.056 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:04:56.094 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:05:00.142 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:05:11.194 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:05:15.226 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:05:26.290 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:05:30.306 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:05:41.374 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:05:45.382 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:05:56.458 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-10-21T12:05:56.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:00.456 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-21T12:06:00.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:14.910 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-21T12:06:19.002 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-21T12:06:20.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:23.998 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-21T12:06:25.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:28.062 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-21T12:06:30.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:33.082 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-21T12:06:34.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:37.150 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-21T12:06:39.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:42.138 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-21T12:06:43.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:46.234 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-21T12:06:48.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:06:52.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:07:06.618 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-21T12:07:12.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:07:15.706 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-21T12:07:21.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:07:22.755 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T12:07:22.756 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T12:07:48.407 INFO:teuthology.provision.fog.smithi071:Node is ready 2023-10-21T12:07:48.408 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2023-10-21T12:07:48.433 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2023-10-21T12:07:48.433 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2023-10-21T12:07:48.493 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2023-10-21T12:07:48.494 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-10-21T12:07:48.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2023-10-21T12:07:48.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2023-10-21T12:07:48.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2023-10-21T12:07:48.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-10-21T12:07:48.857 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-10-21T12:07:48.917 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-10-21T12:07:48.918 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-10-21T12:07:48.918 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-10-21T12:07:48.918 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:07:48.918 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-10-21T12:07:48.919 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:07:48.919 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:07:48.919 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-10-21T12:07:48.919 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:07:48.919 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:07:48.920 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:07:48.920 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:07:48.920 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:07:48.921 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2023-10-21T12:07:48.923 DEBUG:teuthology.parallel:result is None 2023-10-21T12:07:52.242 WARNING:teuthology.provision.fog.smithi192:timed out 2023-10-21T12:07:58.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:07:58.528 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T12:07:58.529 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T12:07:58.768 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-10-21T12:07:58.768 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-10-21T12:07:58.787 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-10-21T12:07:58.787 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-10-21T12:07:58.846 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-10-21T12:07:58.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-21T12:07:58.944 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-10-21T12:07:58.973 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-10-21T12:07:59.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-10-21T12:07:59.108 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-21T12:07:59.174 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-21T12:07:59.233 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-10-21T12:07:59.233 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-10-21T12:07:59.234 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-10-21T12:07:59.234 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:07:59.234 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-10-21T12:07:59.234 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:07:59.234 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:07:59.235 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-21T12:07:59.235 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:07:59.235 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:07:59.235 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:07:59.235 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:07:59.236 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:07:59.236 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-10-21T12:07:59.237 DEBUG:teuthology.parallel:result is None 2023-10-21T12:07:59.382 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2023-10-21T12:07:59.383 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T12:07:59.402 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-10-21T12:07:59.402 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T12:07:59.419 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2023-10-21T12:07:59.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-21T12:07:59.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:07:59.489 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-10-21T12:07:59.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-21T12:07:59.626 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-10-21T12:07:59.684 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-10-21T12:07:59.685 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-10-21T12:07:59.743 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-10-21T12:07:59.744 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-10-21T12:07:59.744 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-10-21T12:07:59.744 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:07:59.744 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-10-21T12:07:59.745 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:07:59.745 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:07:59.745 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-10-21T12:07:59.745 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:07:59.745 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:07:59.745 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:07:59.746 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:07:59.746 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:07:59.747 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-10-21T12:07:59.777 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-10-21T12:07:59.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-21T12:07:59.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T12:07:59.846 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-21T12:07:59.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-21T12:07:59.912 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-10-21T12:07:59.970 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-10-21T12:07:59.970 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-21T12:08:00.028 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-10-21T12:08:00.028 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-10-21T12:08:00.028 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-10-21T12:08:00.028 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-10-21T12:08:00.029 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-10-21T12:08:00.029 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-10-21T12:08:00.029 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T12:08:00.029 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-21T12:08:00.029 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T12:08:00.030 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-10-21T12:08:00.030 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T12:08:00.030 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T12:08:00.030 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T12:08:00.031 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-21T12:08:00.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T12:08:00.147 INFO:teuthology.dispatcher.supervisor:Running job 7434101 2023-10-21T12:08:00.147 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434101 --name yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434101/orig.config.yaml 2023-10-21T12:08:00.150 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434101 2023-10-21T12:08:00.151 INFO:teuthology.dispatcher.supervisor:Job PID: 611005 2023-10-21T12:08:00.151 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T12:10:00.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T12:12:00.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T12:12:00.513 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T12:12:00.599 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T12:12:00.600 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T12:12:00.647 DEBUG:teuthology.nuke:shortname: smithi071 2023-10-21T12:12:00.648 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T12:12:00.674 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434101', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 12:02:52.097681', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKhfwK9vWmmUtsqTrt7fl+JH6+FSxlGGz6T7rQiIOSYmwVrrI+lJfmmlTJaFyH7JKRcYdO/6xDzUC/k2ps64LJU='} 2023-10-21T12:12:00.678 DEBUG:teuthology.nuke:shortname: smithi192 2023-10-21T12:12:00.678 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T12:12:00.701 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434101', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 12:02:52.099289', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDEnPXEqsZoZ4ZmUGEJEekf309vRyLjm0XailSNm4xFszH7vuRZ+I/kw4BeAVtnCShFSLGLUztaXz08Hxed7g9c='} 2023-10-21T12:12:00.730 INFO:teuthology.orchestra.console.smithi071:Power off 2023-10-21T12:12:00.731 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T12:12:00.756 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-10-21T12:12:00.757 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:12:00.775 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-21T12:12:00.775 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T12:12:00.785 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-10-21T12:12:00.795 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-21T12:12:00.796 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T12:12:00.820 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-21T12:12:00.887 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-10-21T12:12:00.921 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-21T12:12:01.036 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2023-10-21T12:12:01.061 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com