2023-10-30T19:45:28.066 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-30T19:45:28.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T19:45:28.210 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3815665670>, signals=[15]) 2023-10-30T19:45:28.211 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-10-30T19:45:28.212 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-10-30T19:45:28.212 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-30T19:45:28.240 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-10-30T19:45:28.240 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-10-30T19:45:28.240 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-30T19:45:28.242 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-10-30T19:45:28.265 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-10-30T19:45:28.318 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-30T19:45:28.332 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-30T19:45:28.360 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2023-10-30T19:45:28.360 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 10} 2023-10-30T19:45:28.372 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_9.stream (ID 10) 2023-10-30T19:45:28.373 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 10} 2023-10-30T19:45:28.422 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2023-10-30T19:45:28.422 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:45:28.425 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 9.stream 2023-10-30T19:45:28.426 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:45:28.481 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-10-30T19:45:28.486 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-10-30T19:45:28.517 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-10-30T19:45:28.531 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-10-30T19:45:28.579 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:45:28.583 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:45:28.660 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-30T19:45:28.661 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T19:45:28.674 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-30T19:45:28.674 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T19:45:28.683 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-30T19:45:28.684 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:28.696 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-30T19:45:28.696 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:28.704 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-30T19:45:28.718 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-30T19:45:32.706 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:32.719 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:32.816 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-30T19:45:32.828 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-30T19:45:36.818 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:36.829 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:36.929 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-30T19:45:36.937 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-30T19:45:37.031 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-30T19:45:37.132 INFO:teuthology.orchestra.console.smithi092:Power on 2023-10-30T19:45:37.132 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-30T19:45:37.152 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2023-10-30T19:45:37.153 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:37.174 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-30T19:45:40.942 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:41.051 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-30T19:45:41.151 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-30T19:45:41.175 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:41.253 INFO:teuthology.orchestra.console.smithi059:Power on 2023-10-30T19:45:41.254 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-30T19:45:41.275 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-10-30T19:45:41.276 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:41.285 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-30T19:45:41.297 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-30T19:45:45.290 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:45.298 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:45.408 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-30T19:45:45.517 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-30T19:45:45.617 INFO:teuthology.orchestra.console.smithi092:Power on completed 2023-10-30T19:45:45.718 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-10-30T19:45:45.719 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:45:49.413 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T19:45:49.521 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-30T19:45:49.622 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-10-30T19:45:49.723 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-10-30T19:45:49.782 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:46:00.794 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:46:04.850 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:46:15.857 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:46:19.914 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:46:30.926 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:46:34.970 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:46:45.991 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:46:50.026 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:47:01.054 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:47:05.098 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:47:16.114 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:47:20.154 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:47:31.178 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:47:35.210 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:47:46.238 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:47:50.266 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:48:01.302 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:48:05.322 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:48:16.370 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:48:20.390 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-30T19:48:20.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:48:31.438 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-30T19:48:31.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:48:38.906 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-30T19:48:44.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:48:47.962 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-30T19:48:49.918 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-30T19:48:53.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:48:55.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:48:57.054 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-30T19:48:59.006 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-30T19:49:03.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:49:05.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:49:08.094 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-30T19:49:14.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:49:17.182 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-30T19:49:23.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:49:41.626 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-30T19:49:47.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:49:50.682 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-30T19:49:56.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:49:59.738 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-30T19:50:03.062 WARNING:teuthology.provision.fog.smithi059:timed out 2023-10-30T19:50:05.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:50:06.396 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-30T19:50:06.397 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-30T19:50:09.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:50:09.298 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-30T19:50:09.299 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-30T19:50:09.632 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-10-30T19:50:09.633 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-10-30T19:50:09.648 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-10-30T19:50:09.649 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-10-30T19:50:09.705 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-10-30T19:50:09.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-30T19:50:09.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-10-30T19:50:09.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-10-30T19:50:09.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-10-30T19:50:10.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-30T19:50:10.074 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-30T19:50:10.129 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-30T19:50:10.130 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-10-30T19:50:10.130 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-30T19:50:10.130 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-30T19:50:10.130 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-10-30T19:50:10.131 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-10-30T19:50:10.131 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T19:50:10.131 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-30T19:50:10.131 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-10-30T19:50:10.131 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T19:50:10.132 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-30T19:50:10.132 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T19:50:10.132 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T19:50:10.132 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T19:50:10.133 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-10-30T19:50:10.134 DEBUG:teuthology.parallel:result is None 2023-10-30T19:50:21.736 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-10-30T19:50:21.736 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-10-30T19:50:21.753 INFO:teuthology.orchestra.run.smithi092.stdout:smithi046 2023-10-30T19:50:21.754 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi046 /etc/hosts 2023-10-30T19:50:21.811 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-10-30T19:50:21.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-10-30T19:50:21.947 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi046/smithi092/g' /etc/hosts 2023-10-30T19:50:21.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.46/172.21.15.92/g' /etc/hosts 2023-10-30T19:50:22.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi046/smithi092/g' /etc/hostname 2023-10-30T19:50:22.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-10-30T19:50:22.189 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-30T19:50:22.246 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2023-10-30T19:50:22.246 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2023-10-30T19:50:22.246 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2023-10-30T19:50:22.246 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2023-10-30T19:50:22.247 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2023-10-30T19:50:22.247 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2023-10-30T19:50:22.247 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T19:50:22.247 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-30T19:50:22.247 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2023-10-30T19:50:22.248 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T19:50:22.248 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2023-10-30T19:50:22.248 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T19:50:22.248 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T19:50:22.248 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T19:50:22.249 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-10-30T19:50:22.250 DEBUG:teuthology.parallel:result is None 2023-10-30T19:50:22.421 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-10-30T19:50:22.422 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-30T19:50:22.438 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-10-30T19:50:22.438 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-30T19:50:22.455 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-10-30T19:50:22.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-30T19:50:22.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:50:22.554 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-30T19:50:22.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-30T19:50:22.737 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-30T19:50:22.793 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-30T19:50:22.793 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-30T19:50:22.849 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-30T19:50:22.849 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-10-30T19:50:22.849 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-30T19:50:22.849 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-30T19:50:22.850 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-10-30T19:50:22.850 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-10-30T19:50:22.850 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T19:50:22.850 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-30T19:50:22.850 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-10-30T19:50:22.851 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T19:50:22.851 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-30T19:50:22.851 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T19:50:22.851 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T19:50:22.852 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T19:50:22.852 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-30T19:50:22.871 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-10-30T19:50:22.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-30T19:50:22.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T19:50:22.955 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-30T19:50:23.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-30T19:50:23.025 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-30T19:50:23.079 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-30T19:50:23.080 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-30T19:50:23.134 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2023-10-30T19:50:23.134 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2023-10-30T19:50:23.135 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2023-10-30T19:50:23.135 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2023-10-30T19:50:23.135 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2023-10-30T19:50:23.135 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2023-10-30T19:50:23.136 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T19:50:23.136 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-30T19:50:23.136 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2023-10-30T19:50:23.136 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T19:50:23.136 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2023-10-30T19:50:23.137 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T19:50:23.137 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T19:50:23.137 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T19:50:23.138 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-30T19:50:23.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T19:50:23.246 INFO:teuthology.dispatcher.supervisor:Running job 7441420 2023-10-30T19:50:23.247 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2023-10-30_19:40:56-rgw:notifications-wip-yuval-notify-lctrans-distro-default-smithi/7441420 --name yuvalif-2023-10-30_19:40:56-rgw:notifications-wip-yuval-notify-lctrans-distro-default-smithi --description rgw:notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} -- /home/teuthworker/archive/yuvalif-2023-10-30_19:40:56-rgw:notifications-wip-yuval-notify-lctrans-distro-default-smithi/7441420/orig.config.yaml 2023-10-30T19:50:23.251 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2023-10-30_19:40:56-rgw:notifications-wip-yuval-notify-lctrans-distro-default-smithi/7441420 2023-10-30T19:50:23.251 INFO:teuthology.dispatcher.supervisor:Job PID: 2699460 2023-10-30T19:50:23.252 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-30T19:52:23.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T19:54:23.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T19:56:23.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T19:58:23.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:00:24.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:02:24.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:04:24.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:06:24.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:08:24.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:10:24.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:12:25.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:14:25.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:16:25.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:18:25.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:20:25.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:22:25.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:24:26.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:26:26.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:28:26.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:30:26.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:32:26.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:34:26.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T20:34:26.945 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-30T20:34:27.043 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-30T20:34:27.043 INFO:teuthology.nuke:Checking targets against current locks 2023-10-30T20:34:27.092 DEBUG:teuthology.nuke:shortname: smithi059 2023-10-30T20:34:27.093 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-30T20:34:27.115 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-30T20:34:27.115 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-30T20:34:27.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-10-30_19:40:56-rgw:notifications-wip-yuval-notify-lctrans-distro-default-smithi/7441420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 19:45:27.275492', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLu3nbUcPDuAK2dfhWev5MbXH2+dWJML62XlkwJ6KbNpB8ElhZl4xoqiBzzTbz62Mhc/psJ1dUu6EcoLUM2u704='} 2023-10-30T20:34:27.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-10-30_19:40:56-rgw:notifications-wip-yuval-notify-lctrans-distro-default-smithi/7441420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 19:45:27.277075', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3UXtVtd5JtoGlNPTndQPz9TT7Yx7F3XP+6TBLHT1kjV1gCFJSZvTWl1aGDjJIhmUmAva3gVBD8nf2VVo51bK4='} 2023-10-30T20:34:27.170 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-30T20:34:27.171 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T20:34:27.195 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-30T20:34:27.195 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T20:34:27.209 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-30T20:34:27.209 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T20:34:27.218 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-30T20:34:27.231 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-30T20:34:27.232 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T20:34:27.253 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-30T20:34:27.320 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-30T20:34:27.355 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-30T20:34:27.469 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-10-30T20:34:27.502 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com