2023-11-03T12:06:19.284 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-03T12:06:19.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:06:19.431 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe5d5654670>, signals=[15]) 2023-11-03T12:06:19.432 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-11-03T12:06:19.433 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T12:06:19.433 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-03T12:06:19.452 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-11-03T12:06:19.453 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T12:06:19.453 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-11-03T12:06:19.454 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-11-03T12:06:19.476 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-11-03T12:06:19.532 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-03T12:06:19.548 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-03T12:06:19.580 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10) 2023-11-03T12:06:19.581 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 10} 2023-11-03T12:06:19.587 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_9.stream (ID 10) 2023-11-03T12:06:19.587 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 10} 2023-11-03T12:06:19.628 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 9.stream 2023-11-03T12:06:19.628 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:06:19.632 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream 2023-11-03T12:06:19.632 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:06:19.693 DEBUG:teuthology.provision.fog.smithi142:Canceling deploy task with ID 580742 2023-11-03T12:06:19.694 DEBUG:teuthology.provision.fog.smithi142:FOG request: DELETE /task/cancel {"id": 580742} 2023-11-03T12:06:19.698 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T12:06:19.742 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-11-03T12:06:19.793 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:06:19.908 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-03T12:06:19.909 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T12:06:19.934 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-03T12:06:19.935 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:19.960 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-03T12:06:19.978 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T12:06:20.021 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-11-03T12:06:20.084 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:06:20.179 INFO:teuthology.orchestra.console.smithi142:Power off 2023-11-03T12:06:20.180 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T12:06:20.205 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-11-03T12:06:20.205 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:20.227 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-11-03T12:06:23.965 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:24.074 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-03T12:06:24.230 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:24.339 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-11-03T12:06:28.078 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:28.188 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-03T12:06:28.289 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-03T12:06:28.341 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:28.390 INFO:teuthology.orchestra.console.smithi033:Power on 2023-11-03T12:06:28.391 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T12:06:28.411 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-11-03T12:06:28.412 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:28.434 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-03T12:06:28.454 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-11-03T12:06:28.554 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-11-03T12:06:28.655 INFO:teuthology.orchestra.console.smithi142:Power on 2023-11-03T12:06:28.656 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T12:06:28.678 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2023-11-03T12:06:28.679 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:28.704 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-11-03T12:06:32.438 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:32.547 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-03T12:06:32.706 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:32.814 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-11-03T12:06:36.550 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:36.659 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-03T12:06:36.760 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-11-03T12:06:36.816 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:06:36.862 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-11-03T12:06:36.863 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:06:36.924 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-11-03T12:06:37.025 INFO:teuthology.orchestra.console.smithi142:Power on completed 2023-11-03T12:06:37.127 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-11-03T12:06:37.127 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:06:51.955 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:06:52.204 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:07:07.042 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:07:07.276 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:07:22.122 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:07:22.344 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:07:37.206 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:07:37.418 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:07:52.302 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:07:52.488 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:08:07.406 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:08:07.578 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:08:22.490 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:08:22.658 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:08:37.578 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:08:37.729 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:08:52.662 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-03T12:08:52.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:08:52.795 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:08:55.802 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-03T12:09:01.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:09:04.858 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-03T12:09:07.862 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-11-03T12:09:07.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:09:10.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:09:13.914 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-03T12:09:19.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:09:22.970 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-03T12:09:28.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:09:32.029 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-03T12:09:38.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:09:42.522 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-11-03T12:09:48.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:09:51.578 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-11-03T12:09:57.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:10:00.634 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-11-03T12:10:06.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:10:38.068 WARNING:teuthology.provision.fog.smithi033:timed out 2023-11-03T12:10:44.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:10:44.325 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T12:10:44.326 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T12:10:44.664 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-11-03T12:10:44.665 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-11-03T12:10:44.680 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-11-03T12:10:44.681 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-11-03T12:10:44.738 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-11-03T12:10:44.738 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-03T12:10:44.868 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-11-03T12:10:44.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-11-03T12:10:44.972 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-11-03T12:10:45.043 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-03T12:10:45.114 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-03T12:10:45.170 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-11-03T12:10:45.170 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-11-03T12:10:45.170 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-11-03T12:10:45.170 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-11-03T12:10:45.171 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-11-03T12:10:45.171 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-11-03T12:10:45.171 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T12:10:45.171 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-11-03T12:10:45.171 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-11-03T12:10:45.172 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T12:10:45.172 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-11-03T12:10:45.172 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:10:45.172 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T12:10:45.173 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T12:10:45.174 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-11-03T12:10:45.177 DEBUG:teuthology.parallel:result is None 2023-11-03T12:11:06.666 WARNING:teuthology.provision.fog.smithi142:timed out 2023-11-03T12:11:12.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:11:13.025 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T12:11:13.026 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T12:11:13.379 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-11-03T12:11:13.379 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-11-03T12:11:13.396 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-11-03T12:11:13.397 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-11-03T12:11:13.452 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-11-03T12:11:13.453 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-11-03T12:11:13.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-11-03T12:11:13.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-11-03T12:11:13.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-11-03T12:11:13.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-11-03T12:11:13.803 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-11-03T12:11:13.857 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-11-03T12:11:13.857 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2023-11-03T12:11:13.858 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-11-03T12:11:13.858 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-11-03T12:11:13.858 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2023-11-03T12:11:13.859 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2023-11-03T12:11:13.859 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T12:11:13.859 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-11-03T12:11:13.859 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2023-11-03T12:11:13.859 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T12:11:13.860 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-11-03T12:11:13.860 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:11:13.860 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T12:11:13.860 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T12:11:13.861 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-11-03T12:11:13.862 DEBUG:teuthology.parallel:result is None 2023-11-03T12:11:14.058 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-11-03T12:11:14.059 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T12:11:14.078 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-11-03T12:11:14.079 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T12:11:14.101 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-11-03T12:11:14.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-03T12:11:14.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:11:14.205 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-11-03T12:11:14.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-03T12:11:14.385 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-11-03T12:11:14.441 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-11-03T12:11:14.442 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-03T12:11:14.497 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-11-03T12:11:14.498 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-11-03T12:11:14.498 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-11-03T12:11:14.499 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-11-03T12:11:14.499 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-11-03T12:11:14.499 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-11-03T12:11:14.500 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T12:11:14.500 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-11-03T12:11:14.500 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-11-03T12:11:14.501 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T12:11:14.501 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-11-03T12:11:14.502 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:11:14.502 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T12:11:14.502 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T12:11:14.503 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-03T12:11:14.530 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-11-03T12:11:14.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-11-03T12:11:14.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T12:11:14.613 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-11-03T12:11:14.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-11-03T12:11:14.676 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-11-03T12:11:14.730 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-11-03T12:11:14.731 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-11-03T12:11:14.785 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-11-03T12:11:14.785 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2023-11-03T12:11:14.786 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-11-03T12:11:14.786 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-11-03T12:11:14.786 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2023-11-03T12:11:14.786 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2023-11-03T12:11:14.786 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T12:11:14.787 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-11-03T12:11:14.787 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2023-11-03T12:11:14.787 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T12:11:14.787 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-11-03T12:11:14.787 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T12:11:14.788 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T12:11:14.788 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T12:11:14.788 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-11-03T12:11:14.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:11:14.930 INFO:teuthology.dispatcher.supervisor:Running job 7445496 2023-11-03T12:11:14.931 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445496 --name rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} -- /home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445496/orig.config.yaml 2023-11-03T12:11:14.938 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445496 2023-11-03T12:11:14.939 INFO:teuthology.dispatcher.supervisor:Job PID: 2219391 2023-11-03T12:11:14.940 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-03T12:13:15.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:13:15.104 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-03T12:13:15.217 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-03T12:13:15.217 INFO:teuthology.nuke:Checking targets against current locks 2023-11-03T12:13:15.278 DEBUG:teuthology.nuke:shortname: smithi033 2023-11-03T12:13:15.279 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T12:13:15.306 DEBUG:teuthology.nuke:shortname: smithi142 2023-11-03T12:13:15.307 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T12:13:15.310 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 12:06:18.450673', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIecVsfHmMBRHNQrCuTPD4HQmnmYKeG4sR5FdJ47y/KkgOLtWIY7+LkU6lLczu2X5ihtIPIGH+CEJv/po8W5alg='} 2023-11-03T12:13:15.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-03_12:04:16-fs:volumes-rishabh-mgr-vol-flake-warnings-testing-default-smithi/7445496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 12:06:18.452349', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRilYoV7MotIW/BkIZkL3pLeH2kkYebpZ2CXOvZJUg7A+4d7U+9On+Er0XXJMG3wYocZ4bCs60Jrs4iq2Kadjw='} 2023-11-03T12:13:15.369 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-03T12:13:15.374 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T12:13:15.401 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-03T12:13:15.403 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:13:15.419 INFO:teuthology.orchestra.console.smithi142:Power off 2023-11-03T12:13:15.420 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T12:13:15.430 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-03T12:13:15.445 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-11-03T12:13:15.445 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:13:15.472 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-11-03T12:13:15.531 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-03T12:13:15.574 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-11-03T12:13:15.695 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-11-03T12:13:15.707 ERROR:teuthology.lock.ops:failed to unlock smithi142.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node