2023-10-04T13:13:45.470 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-04T13:13:45.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:13:45.739 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff55595b670>, signals=[15]) 2023-10-04T13:13:45.740 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-10-04T13:13:45.740 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-10-04T13:13:45.741 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-04T13:13:45.763 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-10-04T13:13:45.763 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-10-04T13:13:45.764 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-04T13:13:45.765 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-10-04T13:13:45.788 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-10-04T13:13:45.852 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-04T13:13:45.857 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-04T13:13:45.899 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_8.stream (ID 3) 2023-10-04T13:13:45.899 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 3} 2023-10-04T13:13:45.904 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3) 2023-10-04T13:13:45.904 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 3} 2023-10-04T13:13:45.948 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2023-10-04T13:13:45.949 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:13:45.952 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.stream 2023-10-04T13:13:45.952 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:13:46.008 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-10-04T13:13:46.011 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-10-04T13:13:46.047 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-10-04T13:13:46.054 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-10-04T13:13:46.111 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:13:46.113 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:13:46.304 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-04T13:13:46.305 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:13:46.385 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-04T13:13:46.385 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:13:46.424 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-04T13:13:46.425 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:46.466 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-04T13:13:46.466 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:46.491 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-04T13:13:46.516 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-04T13:13:50.499 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:50.523 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:50.625 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-04T13:13:50.692 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-04T13:13:54.626 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:54.693 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:54.765 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-04T13:13:54.841 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-04T13:13:54.942 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-04T13:13:55.042 INFO:teuthology.orchestra.console.smithi105:Power on 2023-10-04T13:13:55.042 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-04T13:13:55.097 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2023-10-04T13:13:55.098 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:55.169 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-04T13:13:58.770 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:58.907 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-04T13:13:59.007 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-04T13:13:59.108 INFO:teuthology.orchestra.console.smithi079:Power on 2023-10-04T13:13:59.108 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-04T13:13:59.171 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:59.197 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-10-04T13:13:59.197 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:13:59.288 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-04T13:13:59.297 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-04T13:13:59.398 INFO:teuthology.orchestra.console.smithi105:Power on completed 2023-10-04T13:13:59.499 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-10-04T13:13:59.499 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:14:03.290 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:14:03.417 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-04T13:14:03.518 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-10-04T13:14:03.619 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-10-04T13:14:03.619 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:14:14.570 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:14:18.705 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:14:29.655 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:14:33.850 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:14:44.758 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:14:48.938 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:14:59.870 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:15:04.066 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:15:14.994 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:15:19.182 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:15:30.106 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:15:34.262 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:15:45.190 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:15:49.346 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:16:00.282 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:16:04.450 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:16:15.379 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:16:19.531 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:16:31.841 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:16:34.649 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:16:47.002 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-04T13:16:47.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:16:49.738 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:16:50.170 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-04T13:16:56.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:16:59.226 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-04T13:17:04.822 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-04T13:17:04.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:05.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:07.962 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-04T13:17:08.286 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-04T13:17:13.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:14.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:17.050 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-04T13:17:17.370 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-04T13:17:23.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:23.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:26.106 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-04T13:17:26.426 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-04T13:17:32.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:32.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:35.166 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-04T13:17:35.484 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-04T13:17:41.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:41.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:44.251 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-04T13:17:50.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:17:53.306 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-04T13:17:59.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:18:02.366 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-04T13:18:08.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:18:41.518 WARNING:teuthology.provision.fog.smithi105:timed out 2023-10-04T13:18:47.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:18:47.776 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-04T13:18:47.777 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-04T13:18:48.027 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-10-04T13:18:48.027 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-10-04T13:18:48.046 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-10-04T13:18:48.047 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-10-04T13:18:48.105 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-10-04T13:18:48.106 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-10-04T13:18:48.213 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-10-04T13:18:48.242 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-10-04T13:18:48.310 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-10-04T13:18:48.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-10-04T13:18:48.444 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-04T13:18:48.502 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-10-04T13:18:48.502 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-10-04T13:18:48.502 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-10-04T13:18:48.502 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:18:48.502 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-10-04T13:18:48.502 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:18:48.503 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:18:48.503 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-10-04T13:18:48.503 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:18:48.503 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:18:48.503 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:18:48.504 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:18:48.504 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:18:48.504 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-10-04T13:18:48.505 DEBUG:teuthology.parallel:result is None 2023-10-04T13:19:08.390 WARNING:teuthology.provision.fog.smithi079:timed out 2023-10-04T13:19:14.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:19:14.604 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-04T13:19:14.605 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-04T13:19:14.857 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-10-04T13:19:14.858 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-10-04T13:19:14.878 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-10-04T13:19:14.878 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-10-04T13:19:14.938 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-10-04T13:19:14.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-10-04T13:19:15.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-10-04T13:19:15.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-10-04T13:19:15.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-10-04T13:19:15.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-10-04T13:19:15.300 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:19:15.360 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-04T13:19:15.361 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:19:15.361 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:19:15.361 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:19:15.361 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:19:15.361 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:19:15.361 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-10-04T13:19:15.362 DEBUG:teuthology.parallel:result is None 2023-10-04T13:19:15.659 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-10-04T13:19:15.660 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-04T13:19:15.684 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-10-04T13:19:15.684 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-04T13:19:15.710 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-10-04T13:19:15.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-04T13:19:15.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:19:15.829 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-04T13:19:15.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-04T13:19:15.901 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-10-04T13:19:15.962 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-10-04T13:19:15.963 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-04T13:19:16.022 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-10-04T13:19:16.022 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2023-10-04T13:19:16.022 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-10-04T13:19:16.022 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:19:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:19:16.024 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-04T13:19:16.051 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-10-04T13:19:16.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-04T13:19:16.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:19:16.121 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-04T13:19:16.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-04T13:19:16.261 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-10-04T13:19:16.324 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-10-04T13:19:16.325 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-04T13:19:16.390 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-10-04T13:19:16.390 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:19:16.391 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:19:16.392 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-04T13:19:16.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:19:16.676 INFO:teuthology.dispatcher.supervisor:Running job 7410208 2023-10-04T13:19:16.676 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_amaredia@teuthology --archive /home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410208 --name amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410208/orig.config.yaml 2023-10-04T13:19:16.679 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410208 2023-10-04T13:19:16.680 INFO:teuthology.dispatcher.supervisor:Job PID: 1735284 2023-10-04T13:19:16.680 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-04T13:21:16.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:23:16.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:25:17.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:27:17.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:29:17.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:31:17.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:33:17.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:35:17.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:37:18.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:39:18.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:41:18.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:43:18.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:45:18.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:45:18.525 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-04T13:45:18.654 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-04T13:45:18.654 INFO:teuthology.nuke:Checking targets against current locks 2023-10-04T13:45:18.702 DEBUG:teuthology.nuke:shortname: smithi079 2023-10-04T13:45:18.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-04T13:45:18.721 DEBUG:teuthology.nuke:shortname: smithi105 2023-10-04T13:45:18.721 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-04T13:45:18.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410208', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-04 13:13:43.663521', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhchd+Bg4JOL29IsS0hpEtbrsEk8XmH8hqJwuQEnhGRF2F1drfoJlfc8nr1HIVBYHmng4YZqVuyMiuZDqKfH2E='} 2023-10-04T13:45:18.744 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410208', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-04 13:13:43.664977', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHur/nm+ZkRyDm7gtEcHM2uOZ2+XN0ngfOkF9SZpiZEC/HYft3lBcAx9Xc2t/iw8dNSToMkUt3I1zkv+4c7oUO4='} 2023-10-04T13:45:18.772 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-04T13:45:18.773 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:45:18.792 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-04T13:45:18.792 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:45:18.803 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-04T13:45:18.803 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:45:18.811 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-04T13:45:18.823 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-04T13:45:18.823 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:45:18.841 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-04T13:45:18.912 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-04T13:45:18.942 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-04T13:45:19.066 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-10-04T13:45:19.090 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com