2023-11-03T14:13:56.780 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-03T14:13:56.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:13:56.964 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f703675e670>, signals=[15]) 2023-11-03T14:13:56.966 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-11-03T14:13:56.966 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T14:13:56.967 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-11-03T14:13:56.987 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-11-03T14:13:56.987 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T14:13:56.988 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-03T14:13:56.989 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-11-03T14:13:57.012 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-11-03T14:13:57.056 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-03T14:13:57.081 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-03T14:13:57.104 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10) 2023-11-03T14:13:57.105 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 10} 2023-11-03T14:13:57.121 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_9.stream (ID 10) 2023-11-03T14:13:57.121 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 10} 2023-11-03T14:13:57.153 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream 2023-11-03T14:13:57.153 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:13:57.167 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 9.stream 2023-11-03T14:13:57.167 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:13:57.221 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T14:13:57.229 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T14:13:57.263 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-11-03T14:13:57.267 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-11-03T14:13:57.313 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:13:57.318 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:13:57.413 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-03T14:13:57.414 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T14:13:57.434 INFO:teuthology.orchestra.console.smithi088:Power off 2023-11-03T14:13:57.434 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T14:13:57.444 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-03T14:13:57.445 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:13:57.458 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-11-03T14:13:57.459 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:13:57.468 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-03T14:13:57.480 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-03T14:14:01.471 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:01.481 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:01.582 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-03T14:14:01.591 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-03T14:14:05.586 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:05.593 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:05.695 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-03T14:14:05.702 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-03T14:14:05.797 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-03T14:14:05.898 INFO:teuthology.orchestra.console.smithi148:Power on 2023-11-03T14:14:05.898 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T14:14:05.924 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-11-03T14:14:05.925 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:05.948 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-03T14:14:09.706 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:09.815 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-03T14:14:09.916 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-11-03T14:14:09.949 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:10.017 INFO:teuthology.orchestra.console.smithi088:Power on 2023-11-03T14:14:10.018 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T14:14:10.045 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2023-11-03T14:14:10.045 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:10.058 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-03T14:14:10.069 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-03T14:14:14.063 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:14.071 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:14:14.173 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-03T14:14:14.179 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-03T14:14:14.275 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-11-03T14:14:14.279 INFO:teuthology.orchestra.console.smithi088:Power on completed 2023-11-03T14:14:14.376 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-11-03T14:14:14.377 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:14:14.384 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-11-03T14:14:14.384 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:14:29.462 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:14:29.464 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:14:44.547 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:14:44.549 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:14:59.638 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:14:59.640 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:15:14.726 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:15:14.728 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:15:29.822 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:15:29.824 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:15:44.914 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:15:44.916 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:16:00.010 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:16:00.011 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:16:15.110 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:16:15.112 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:16:30.207 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:16:30.209 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:16:45.290 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-03T14:16:45.292 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:16:45.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:16:48.446 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-03T14:16:54.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:16:57.530 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-03T14:17:00.378 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:17:03.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:06.593 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-03T14:17:12.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:15.458 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-11-03T14:17:15.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:15.678 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-03T14:17:18.586 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-03T14:17:21.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:24.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:24.762 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-03T14:17:27.642 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-03T14:17:30.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:33.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:33.822 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-03T14:17:36.702 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-03T14:17:39.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:42.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:42.874 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-03T14:17:45.786 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-03T14:17:48.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:51.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:17:54.842 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-03T14:18:00.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:18:03.898 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-03T14:18:09.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:18:12.954 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-03T14:18:18.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:18:48.911 WARNING:teuthology.provision.fog.smithi148:timed out 2023-11-03T14:18:54.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:18:55.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T14:18:55.169 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T14:18:55.505 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-11-03T14:18:55.505 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-11-03T14:18:55.520 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-11-03T14:18:55.521 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-11-03T14:18:55.576 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-11-03T14:18:55.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-03T14:18:55.682 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-11-03T14:18:55.710 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-11-03T14:18:55.778 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-11-03T14:18:55.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-03T14:18:55.913 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-03T14:18:55.968 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-11-03T14:18:55.968 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2023-11-03T14:18:55.968 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-11-03T14:18:55.969 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-11-03T14:18:55.969 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2023-11-03T14:18:55.969 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2023-11-03T14:18:55.969 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T14:18:55.970 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-11-03T14:18:55.970 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2023-11-03T14:18:55.970 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T14:18:55.970 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-11-03T14:18:55.970 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T14:18:55.971 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T14:18:55.971 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T14:18:55.972 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-11-03T14:18:55.973 DEBUG:teuthology.parallel:result is None 2023-11-03T14:19:18.983 WARNING:teuthology.provision.fog.smithi088:timed out 2023-11-03T14:19:24.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:19:25.248 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T14:19:25.249 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T14:19:25.583 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-11-03T14:19:25.584 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-11-03T14:19:25.599 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-11-03T14:19:25.599 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-11-03T14:19:25.654 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-11-03T14:19:25.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-11-03T14:19:25.769 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-11-03T14:19:25.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-11-03T14:19:25.865 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-11-03T14:19:25.932 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-11-03T14:19:25.998 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-11-03T14:19:26.053 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-11-03T14:19:26.053 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2023-11-03T14:19:26.053 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-11-03T14:19:26.053 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-11-03T14:19:26.054 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2023-11-03T14:19:26.054 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2023-11-03T14:19:26.054 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T14:19:26.054 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-11-03T14:19:26.054 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2023-11-03T14:19:26.055 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T14:19:26.055 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-11-03T14:19:26.055 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T14:19:26.055 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T14:19:26.056 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T14:19:26.056 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-11-03T14:19:26.057 DEBUG:teuthology.parallel:result is None 2023-11-03T14:19:26.221 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-11-03T14:19:26.221 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T14:19:26.243 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-11-03T14:19:26.244 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T14:19:26.261 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-11-03T14:19:26.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-03T14:19:26.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:19:26.346 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-11-03T14:19:26.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-03T14:19:26.416 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-11-03T14:19:26.471 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-11-03T14:19:26.471 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-11-03T14:19:26.525 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-11-03T14:19:26.526 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2023-11-03T14:19:26.526 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-11-03T14:19:26.526 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-11-03T14:19:26.526 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2023-11-03T14:19:26.527 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2023-11-03T14:19:26.527 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T14:19:26.527 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-11-03T14:19:26.527 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2023-11-03T14:19:26.527 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T14:19:26.527 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-11-03T14:19:26.528 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T14:19:26.528 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T14:19:26.528 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T14:19:26.529 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-11-03T14:19:26.552 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-11-03T14:19:26.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-03T14:19:26.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:19:26.637 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-11-03T14:19:26.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-03T14:19:26.805 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-11-03T14:19:26.861 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-11-03T14:19:26.861 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-03T14:19:26.916 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-11-03T14:19:26.916 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2023-11-03T14:19:26.917 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-11-03T14:19:26.917 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-11-03T14:19:26.917 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2023-11-03T14:19:26.917 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2023-11-03T14:19:26.918 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T14:19:26.918 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-11-03T14:19:26.918 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2023-11-03T14:19:26.918 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T14:19:26.918 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-11-03T14:19:26.919 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T14:19:26.919 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T14:19:26.919 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T14:19:26.920 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-03T14:19:26.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:19:27.040 INFO:teuthology.dispatcher.supervisor:Running job 7445451 2023-11-03T14:19:27.041 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_sseshasa@teuthology --archive /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445451 --name sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445451/orig.config.yaml 2023-11-03T14:19:27.043 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445451 2023-11-03T14:19:27.044 INFO:teuthology.dispatcher.supervisor:Job PID: 62912 2023-11-03T14:19:27.044 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-03T14:21:27.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:23:27.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:25:27.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:27:27.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:29:27.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:31:27.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:33:28.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:35:28.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:37:28.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:39:28.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:41:28.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:43:28.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:45:29.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:47:29.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:49:29.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:51:29.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:53:29.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:55:30.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:57:30.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:59:30.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:01:30.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:03:30.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:05:30.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:07:31.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:09:31.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:11:31.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:13:31.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:15:31.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:17:31.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:17:32.003 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-03T15:17:32.197 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-03T15:17:32.198 INFO:teuthology.nuke:Checking targets against current locks 2023-11-03T15:17:32.247 DEBUG:teuthology.nuke:shortname: smithi088 2023-11-03T15:17:32.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T15:17:32.271 DEBUG:teuthology.nuke:shortname: smithi148 2023-11-03T15:17:32.272 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T15:17:32.276 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 14:13:55.955621', 'locked_by': 'scheduled_sseshasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBiGMc6EbsIsMlYBV9pkXDxU1+TwRD0IdxBlMzKCSLQsqARss6kOKAJyqdpngnvYeqd2bNq5I78SvWWtzNYNMFU='} 2023-11-03T15:17:32.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 14:13:55.957101', 'locked_by': 'scheduled_sseshasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG8KBfIT6cIOE4oup/NthY6K3bKqwvowpe3uL6Gm48DvkNnB5r/zsyUpwid10ypFeJwLvtZotUdwEx9L9CrnpJU='} 2023-11-03T15:17:32.324 INFO:teuthology.orchestra.console.smithi088:Power off 2023-11-03T15:17:32.325 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T15:17:32.349 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-11-03T15:17:32.350 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:17:32.363 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-03T15:17:32.364 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T15:17:32.371 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-03T15:17:32.384 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-03T15:17:32.384 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:17:32.404 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-03T15:17:32.473 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-11-03T15:17:32.506 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-03T15:17:32.628 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-11-03T15:17:32.651 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com