2023-08-21T22:00:08.948 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-21T22:00:08.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:00:09.088 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc8660dff70>, signals=[15]) 2023-08-21T22:00:09.090 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-08-21T22:00:09.090 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T22:00:09.090 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-08-21T22:00:09.108 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-08-21T22:00:09.108 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T22:00:09.108 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-21T22:00:09.110 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"} 2023-08-21T22:00:09.132 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-08-21T22:00:09.177 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-21T22:00:09.194 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-21T22:00:09.232 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_8.stream (ID 3) 2023-08-21T22:00:09.233 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 3} 2023-08-21T22:00:09.236 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3) 2023-08-21T22:00:09.236 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 3} 2023-08-21T22:00:09.278 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 8.stream 2023-08-21T22:00:09.278 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:00:09.282 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream 2023-08-21T22:00:09.282 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:00:09.338 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T22:00:09.342 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T22:00:09.375 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-08-21T22:00:09.378 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1} 2023-08-21T22:00:09.429 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:00:09.433 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:00:09.535 INFO:teuthology.orchestra.console.smithi110:Power off 2023-08-21T22:00:09.536 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T22:00:09.550 INFO:teuthology.orchestra.console.smithi169:Power off 2023-08-21T22:00:09.552 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T22:00:09.562 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-08-21T22:00:09.563 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:09.575 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-08-21T22:00:09.575 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:09.585 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-08-21T22:00:09.601 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-21T22:00:13.588 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:13.603 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:13.699 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-08-21T22:00:13.713 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-21T22:00:17.704 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:17.715 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:17.816 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-08-21T22:00:17.827 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-21T22:00:17.918 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-08-21T22:00:18.019 INFO:teuthology.orchestra.console.smithi110:Power on 2023-08-21T22:00:18.019 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T22:00:18.040 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2023-08-21T22:00:18.041 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:18.062 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-08-21T22:00:21.831 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:21.941 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-21T22:00:22.042 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-08-21T22:00:22.064 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:22.143 INFO:teuthology.orchestra.console.smithi169:Power on 2023-08-21T22:00:22.144 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T22:00:22.168 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-08-21T22:00:22.169 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:22.179 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-08-21T22:00:22.192 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-21T22:00:26.184 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:26.193 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:26.295 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-08-21T22:00:26.305 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-21T22:00:26.396 INFO:teuthology.orchestra.console.smithi110:Power on completed 2023-08-21T22:00:26.497 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-08-21T22:00:26.498 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:00:30.308 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T22:00:30.419 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-21T22:00:30.520 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-08-21T22:00:30.621 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-08-21T22:00:30.621 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:00:41.580 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:00:45.689 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:00:56.652 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:01:00.755 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:01:11.725 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:01:15.821 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:01:26.808 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:01:30.892 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:01:41.884 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:01:45.968 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:01:56.960 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:02:01.052 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:02:12.032 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:02:16.140 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:02:27.116 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:02:31.220 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:02:42.200 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:02:46.308 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:02:57.288 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:03:01.386 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:03:12.361 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-08-21T22:03:12.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:15.504 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-21T22:03:16.460 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-21T22:03:16.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:19.600 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-21T22:03:21.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:24.560 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-21T22:03:25.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:28.656 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-21T22:03:30.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:33.620 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-21T22:03:34.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:37.712 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-21T22:03:39.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:42.704 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-21T22:03:43.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:46.772 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-21T22:03:48.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:51.760 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-21T22:03:52.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:03:55.856 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-21T22:03:57.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:04:00.816 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-21T22:04:01.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:04:04.912 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-21T22:04:06.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:04:10.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:04:38.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T22:04:38.645 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T22:05:03.992 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-08-21T22:05:03.993 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-08-21T22:05:04.017 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-08-21T22:05:04.018 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-08-21T22:05:04.077 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-08-21T22:05:04.078 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-08-21T22:05:04.200 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-08-21T22:05:04.231 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-08-21T22:05:04.301 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-08-21T22:05:04.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-08-21T22:05:04.438 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-08-21T22:05:04.495 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-08-21T22:05:04.495 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2023-08-21T22:05:04.496 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-08-21T22:05:04.496 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-08-21T22:05:04.496 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2023-08-21T22:05:04.497 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-08-21T22:05:04.497 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T22:05:04.497 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-08-21T22:05:04.497 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T22:05:04.497 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-08-21T22:05:04.497 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T22:05:04.497 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T22:05:04.498 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T22:05:04.499 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-08-21T22:05:04.500 DEBUG:teuthology.parallel:result is None 2023-08-21T22:05:10.924 WARNING:teuthology.provision.fog.smithi169:timed out 2023-08-21T22:05:16.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:05:17.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T22:05:17.142 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T22:05:17.391 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-08-21T22:05:17.392 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-08-21T22:05:17.412 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-08-21T22:05:17.412 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-08-21T22:05:17.471 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-08-21T22:05:17.471 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-21T22:05:17.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-08-21T22:05:17.618 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-08-21T22:05:17.688 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-08-21T22:05:17.758 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-21T22:05:17.827 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-21T22:05:17.884 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-08-21T22:05:17.885 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-08-21T22:05:17.885 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-08-21T22:05:17.885 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-08-21T22:05:17.886 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-08-21T22:05:17.886 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-08-21T22:05:17.886 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T22:05:17.886 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-08-21T22:05:17.887 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T22:05:17.887 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-08-21T22:05:17.887 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T22:05:17.887 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T22:05:17.888 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T22:05:17.888 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-08-21T22:05:17.889 DEBUG:teuthology.parallel:result is None 2023-08-21T22:05:18.034 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-08-21T22:05:18.035 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T22:05:18.055 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-08-21T22:05:18.056 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T22:05:18.072 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-08-21T22:05:18.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-21T22:05:18.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:05:18.141 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-08-21T22:05:18.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-21T22:05:18.283 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-08-21T22:05:18.342 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-08-21T22:05:18.342 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-08-21T22:05:18.401 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-08-21T22:05:18.402 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2023-08-21T22:05:18.402 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-08-21T22:05:18.402 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-08-21T22:05:18.402 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2023-08-21T22:05:18.403 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-08-21T22:05:18.403 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T22:05:18.403 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-08-21T22:05:18.403 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T22:05:18.404 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-08-21T22:05:18.404 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T22:05:18.404 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T22:05:18.404 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T22:05:18.405 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-08-21T22:05:18.430 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-08-21T22:05:18.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-21T22:05:18.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T22:05:18.497 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-08-21T22:05:18.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-21T22:05:18.573 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-08-21T22:05:18.632 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-08-21T22:05:18.632 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-21T22:05:18.691 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-08-21T22:05:18.691 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-08-21T22:05:18.691 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-08-21T22:05:18.691 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-08-21T22:05:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-08-21T22:05:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-08-21T22:05:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T22:05:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-08-21T22:05:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T22:05:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-08-21T22:05:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T22:05:18.693 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T22:05:18.693 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T22:05:18.693 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-21T22:05:18.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:05:18.822 INFO:teuthology.dispatcher.supervisor:Running job 7374450 2023-08-21T22:05:18.822 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374450 --name yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi --description fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} -- /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374450/orig.config.yaml 2023-08-21T22:05:18.826 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374450 2023-08-21T22:05:18.827 INFO:teuthology.dispatcher.supervisor:Job PID: 10534 2023-08-21T22:05:18.827 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-21T22:07:18.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:09:19.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:11:19.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:13:19.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:15:19.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:17:19.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:19:19.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:21:20.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:23:20.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:25:20.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:27:20.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:29:20.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:31:20.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:33:21.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:35:21.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:37:21.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:39:21.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:41:21.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:43:21.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:45:22.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:47:22.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:49:22.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:51:22.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:53:22.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:55:22.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:57:23.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T22:59:23.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:01:23.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:03:23.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:05:23.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:07:23.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:09:24.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:11:24.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:13:24.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:15:24.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:17:24.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:19:24.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:19:25.046 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-21T23:19:25.256 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-21T23:19:25.257 INFO:teuthology.nuke:Checking targets against current locks 2023-08-21T23:19:25.308 DEBUG:teuthology.nuke:shortname: smithi110 2023-08-21T23:19:25.309 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T23:19:25.323 DEBUG:teuthology.nuke:shortname: smithi169 2023-08-21T23:19:25.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T23:19:25.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374450', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 22:00:08.063773', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKYMhZ1g2FqUMBEKArJ5XxHPEG/mXDp/9v3kNqbm38I8/Q1KM8u5KwlJqiDrBfvFmDD2vZrh2+6x7gteezlv6Tg='} 2023-08-21T23:19:25.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374450', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 22:00:08.062256', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB7rgzrpDloTuX0sf1wrhVEDLb8yv6REFIDXqo65QDPr1mkk9troQExCR1YObqHufCLSkjBOW5dyo8EJd+Ym1cE='} 2023-08-21T23:19:25.374 INFO:teuthology.orchestra.console.smithi110:Power off 2023-08-21T23:19:25.375 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T23:19:25.395 INFO:teuthology.orchestra.console.smithi169:Power off 2023-08-21T23:19:25.395 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T23:19:25.405 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-08-21T23:19:25.405 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T23:19:25.416 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-08-21T23:19:25.417 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T23:19:25.425 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-08-21T23:19:25.437 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-21T23:19:25.526 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-08-21T23:19:25.538 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-08-21T23:19:25.677 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-08-21T23:19:25.685 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com