2023-10-19T17:24:37.800 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T17:24:37.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:24:37.944 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f305a949670>, signals=[15]) 2023-10-19T17:24:37.945 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-10-19T17:24:37.945 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T17:24:37.946 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-10-19T17:24:37.975 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-10-19T17:24:37.975 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T17:24:37.976 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-10-19T17:24:37.979 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-10-19T17:24:37.998 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-10-19T17:24:38.049 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-19T17:24:38.068 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-19T17:24:38.088 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_9.stream (ID 10) 2023-10-19T17:24:38.089 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 10} 2023-10-19T17:24:38.107 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10) 2023-10-19T17:24:38.108 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 10} 2023-10-19T17:24:38.134 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 9.stream 2023-10-19T17:24:38.134 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:24:38.154 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream 2023-10-19T17:24:38.155 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:24:38.183 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T17:24:38.199 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T17:24:38.226 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-10-19T17:24:38.242 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-10-19T17:24:38.280 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:24:38.293 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:24:38.376 INFO:teuthology.orchestra.console.smithi049:Power off 2023-10-19T17:24:38.377 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T17:24:38.389 INFO:teuthology.orchestra.console.smithi107:Power off 2023-10-19T17:24:38.390 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T17:24:38.399 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-10-19T17:24:38.400 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:38.412 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-10-19T17:24:38.413 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:38.422 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-19T17:24:38.436 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-19T17:24:42.426 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:42.438 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:42.538 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-19T17:24:42.546 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-19T17:24:46.542 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:46.550 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:46.653 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-19T17:24:46.659 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-19T17:24:50.658 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:50.665 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:50.767 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T17:24:50.775 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-19T17:24:50.869 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-10-19T17:24:50.876 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-10-19T17:24:50.971 INFO:teuthology.orchestra.console.smithi049:Power on 2023-10-19T17:24:50.971 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T17:24:50.979 INFO:teuthology.orchestra.console.smithi107:Power on 2023-10-19T17:24:50.980 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T17:24:50.994 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-10-19T17:24:50.994 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:51.001 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-10-19T17:24:51.002 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:51.017 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T17:24:51.025 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-19T17:24:55.022 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:55.029 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:55.131 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T17:24:55.137 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-19T17:24:59.137 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:59.144 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:24:59.246 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-19T17:24:59.253 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-19T17:24:59.348 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-10-19T17:24:59.354 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-10-19T17:24:59.450 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-10-19T17:24:59.450 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:24:59.455 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-10-19T17:24:59.456 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:25:14.526 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:25:14.528 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:25:29.609 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:25:29.611 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:25:44.703 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:25:44.705 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:25:59.782 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:25:59.784 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:26:14.871 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:26:14.873 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:26:29.959 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:26:29.960 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:26:45.054 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:26:45.056 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:27:00.165 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:27:00.166 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:27:15.262 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:27:15.264 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:27:30.379 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-19T17:27:30.380 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:27:30.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:27:45.494 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:27:48.859 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-19T17:27:54.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:27:57.946 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-19T17:28:00.590 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:28:03.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:28:07.002 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-19T17:28:13.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:28:15.665 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:28:16.058 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-19T17:28:22.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:28:25.114 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-19T17:28:30.742 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T17:28:30.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:28:31.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:28:49.274 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:28:55.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:28:58.330 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:29:04.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:29:07.418 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:29:13.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:29:16.474 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:29:22.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:29:25.530 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:29:31.122 WARNING:teuthology.provision.fog.smithi107:timed out 2023-10-19T17:29:31.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:29:34.586 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:29:37.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:29:37.645 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T17:29:37.646 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T17:29:37.970 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-10-19T17:29:37.970 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-10-19T17:29:37.985 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-10-19T17:29:37.986 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-10-19T17:29:38.041 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-10-19T17:29:38.042 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-10-19T17:29:38.149 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-10-19T17:29:38.177 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-10-19T17:29:38.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-10-19T17:29:38.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-10-19T17:29:38.378 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-10-19T17:29:38.432 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-10-19T17:29:38.433 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2023-10-19T17:29:38.433 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-10-19T17:29:38.433 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:29:38.433 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2023-10-19T17:29:38.434 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:29:38.434 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:29:38.434 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-10-19T17:29:38.434 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:29:38.434 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:29:38.435 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:29:38.435 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:29:38.435 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:29:38.435 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:29:38.436 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-10-19T17:29:38.437 DEBUG:teuthology.parallel:result is None 2023-10-19T17:29:40.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:29:43.642 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:29:49.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:29:52.698 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:29:58.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:30:01.754 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T17:30:07.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:31:07.819 WARNING:teuthology.provision.fog.smithi049:timed out 2023-10-19T17:31:13.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:31:14.111 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T17:31:14.111 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T17:31:14.481 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-10-19T17:31:14.482 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-10-19T17:31:14.498 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-10-19T17:31:14.498 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-10-19T17:31:14.554 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-10-19T17:31:14.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-10-19T17:31:14.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-10-19T17:31:14.701 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-10-19T17:31:14.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-10-19T17:31:14.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-10-19T17:31:14.916 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-10-19T17:31:14.971 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-10-19T17:31:14.972 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2023-10-19T17:31:14.972 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-10-19T17:31:14.972 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:31:14.972 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2023-10-19T17:31:14.973 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:31:14.973 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:31:14.973 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-10-19T17:31:14.974 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:31:14.974 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:31:14.974 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:31:14.975 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:31:14.975 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:31:14.975 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:31:14.975 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-10-19T17:31:14.976 DEBUG:teuthology.parallel:result is None 2023-10-19T17:31:15.177 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2023-10-19T17:31:15.178 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T17:31:15.326 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-10-19T17:31:15.326 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T17:31:15.354 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2023-10-19T17:31:15.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-10-19T17:31:15.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:31:15.454 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-10-19T17:31:15.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-10-19T17:31:15.521 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-10-19T17:31:15.576 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-10-19T17:31:15.577 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-10-19T17:31:15.632 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-10-19T17:31:15.633 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2023-10-19T17:31:15.633 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-10-19T17:31:15.633 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:31:15.634 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2023-10-19T17:31:15.634 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:31:15.634 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:31:15.635 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-10-19T17:31:15.635 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:31:15.635 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:31:15.636 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:31:15.636 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:31:15.636 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:31:15.637 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:31:15.638 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-10-19T17:31:15.661 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-10-19T17:31:15.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-10-19T17:31:15.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:31:15.748 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-10-19T17:31:15.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-10-19T17:31:15.917 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-10-19T17:31:15.971 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-10-19T17:31:15.971 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-10-19T17:31:16.025 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-10-19T17:31:16.025 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2023-10-19T17:31:16.026 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-10-19T17:31:16.026 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:31:16.026 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2023-10-19T17:31:16.026 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:31:16.026 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:31:16.027 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-10-19T17:31:16.027 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:31:16.027 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:31:16.027 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:31:16.027 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:31:16.028 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:31:16.028 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:31:16.028 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-10-19T17:31:16.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:31:16.160 INFO:teuthology.dispatcher.supervisor:Running job 7432441 2023-10-19T17:31:16.160 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432441 --name yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432441/orig.config.yaml 2023-10-19T17:31:16.164 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432441 2023-10-19T17:31:16.165 INFO:teuthology.dispatcher.supervisor:Job PID: 463646 2023-10-19T17:31:16.165 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T17:33:16.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:35:16.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:37:16.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:39:16.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:41:16.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:43:17.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:45:17.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:47:17.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:49:17.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:51:17.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:53:17.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:55:18.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:57:18.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:59:18.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:01:18.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:03:18.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:05:18.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:07:19.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:09:19.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:11:19.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:13:19.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:15:19.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:17:19.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:19:20.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:21:20.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:23:20.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:25:20.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:27:20.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:29:20.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:31:21.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:33:21.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:35:21.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:37:21.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:39:21.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:41:21.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:43:21.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:45:22.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:47:22.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:49:22.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:51:22.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:53:22.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:55:23.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:57:23.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T18:59:23.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:01:23.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:03:23.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:05:23.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:07:23.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:09:24.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:11:24.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:13:24.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:15:24.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:17:24.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:19:24.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:21:25.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T19:21:25.172 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T19:21:25.349 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T19:21:25.350 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T19:21:25.399 DEBUG:teuthology.nuke:shortname: smithi049 2023-10-19T19:21:25.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T19:21:25.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432441', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 17:24:36.973621', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLi3lvqRnNQLPvBn9HTdt8s7jwfoSgRtUji3gS98IT64fGfOqyjpHXyyAtmmjRbPbf7ZJ7tVbPTbK+4YZ2XWpzQ='} 2023-10-19T19:21:25.423 DEBUG:teuthology.nuke:shortname: smithi107 2023-10-19T19:21:25.424 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T19:21:25.452 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432441', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 17:24:36.972058', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM1+CpQL1cY28IIUOkAPSIOXjbxDOQ3m34INbigX0btW0uPRvTG/nsvXksb9PYjT3b8xW7EFwKnJoBiRuKrLFPk='} 2023-10-19T19:21:25.479 INFO:teuthology.orchestra.console.smithi049:Power off 2023-10-19T19:21:25.480 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T19:21:25.501 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-10-19T19:21:25.501 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T19:21:25.516 INFO:teuthology.orchestra.console.smithi107:Power off 2023-10-19T19:21:25.516 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T19:21:25.525 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T19:21:25.536 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-10-19T19:21:25.536 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T19:21:25.556 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-19T19:21:25.626 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-10-19T19:21:25.658 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-10-19T19:21:25.783 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-10-19T19:21:25.805 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com