2023-08-16T11:59:27.184 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-16T11:59:27.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:59:27.333 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd64176310>, signals=[15]) 2023-08-16T11:59:27.334 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2023-08-16T11:59:27.335 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T11:59:27.335 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-08-16T11:59:27.353 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-08-16T11:59:27.354 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T11:59:27.354 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-08-16T11:59:27.355 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /host {"name": "smithi016"} 2023-08-16T11:59:27.378 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-08-16T11:59:27.425 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-16T11:59:27.449 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-16T11:59:27.472 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_9.stream (ID 10) 2023-08-16T11:59:27.472 DEBUG:teuthology.provision.fog.smithi016:FOG request: PUT /host/122 {"imageID": 10} 2023-08-16T11:59:27.494 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_9.stream (ID 10) 2023-08-16T11:59:27.494 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 10} 2023-08-16T11:59:27.515 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 9.stream 2023-08-16T11:59:27.515 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T11:59:27.537 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 9.stream 2023-08-16T11:59:27.537 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T11:59:27.569 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T11:59:27.591 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T11:59:27.600 DEBUG:teuthology.provision.fog.smithi016:FOG request: POST /host/122/task {"taskTypeID": 1} 2023-08-16T11:59:27.625 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-08-16T11:59:27.732 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T11:59:27.748 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T11:59:27.844 INFO:teuthology.orchestra.console.smithi016:Power off 2023-08-16T11:59:27.845 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:59:27.861 INFO:teuthology.orchestra.console.smithi151:Power off 2023-08-16T11:59:27.862 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:59:27.871 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-08-16T11:59:27.873 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:27.883 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-08-16T11:59:27.884 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:27.895 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-08-16T11:59:27.906 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-08-16T11:59:27.996 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-08-16T11:59:28.007 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-08-16T11:59:28.098 INFO:teuthology.orchestra.console.smithi016:Power on 2023-08-16T11:59:28.098 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T11:59:28.108 INFO:teuthology.orchestra.console.smithi151:Power on 2023-08-16T11:59:28.109 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T11:59:28.121 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2023-08-16T11:59:28.122 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:28.132 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-08-16T11:59:28.133 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:28.146 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-08-16T11:59:28.154 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-08-16T11:59:32.148 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:32.156 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:32.259 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-08-16T11:59:32.268 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-08-16T11:59:32.361 INFO:teuthology.orchestra.console.smithi016:Power on completed 2023-08-16T11:59:32.462 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2023-08-16T11:59:32.462 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T11:59:36.272 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:59:36.381 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-08-16T11:59:36.482 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-08-16T11:59:36.583 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-08-16T11:59:36.584 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T11:59:47.541 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T11:59:51.645 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:00:02.624 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:00:06.724 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:00:17.692 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:00:21.784 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:00:32.760 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:00:36.844 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:00:47.828 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:00:51.906 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:01:02.902 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:01:06.965 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:01:17.968 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:01:22.024 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:01:33.044 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:01:37.092 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:01:48.130 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:01:52.214 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:02:03.219 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-08-16T12:02:03.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:06.352 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-08-16T12:02:07.278 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:02:12.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:15.408 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-08-16T12:02:21.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:22.339 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-08-16T12:02:22.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:24.464 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-08-16T12:02:25.456 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:02:30.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:31.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:33.524 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-08-16T12:02:34.516 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:02:39.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:40.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:42.608 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-08-16T12:02:43.568 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:02:48.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:49.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:02:52.624 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:02:58.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:03:01.680 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:03:07.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:03:10.736 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:03:16.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:03:35.152 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:03:41.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:03:44.208 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-08-16T12:03:48.617 WARNING:teuthology.provision.fog.smithi016:timed out 2023-08-16T12:03:50.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:03:51.980 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T12:03:51.981 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T12:03:54.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:03:54.812 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T12:03:54.812 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T12:03:55.157 INFO:teuthology.provision.fog.smithi016:Node is ready 2023-08-16T12:03:55.158 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2023-08-16T12:03:55.172 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2023-08-16T12:03:55.173 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2023-08-16T12:03:55.227 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2023-08-16T12:03:55.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-08-16T12:03:55.340 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2023-08-16T12:03:55.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2023-08-16T12:03:55.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2023-08-16T12:03:55.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-08-16T12:03:55.581 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-08-16T12:03:55.636 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2023-08-16T12:03:55.636 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2023-08-16T12:03:55.636 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2023-08-16T12:03:55.636 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2023-08-16T12:03:55.637 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T12:03:55.638 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T12:03:55.638 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T12:03:55.638 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2023-08-16T12:03:55.640 DEBUG:teuthology.parallel:result is None 2023-08-16T12:04:17.401 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-08-16T12:04:17.401 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-08-16T12:04:17.420 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-08-16T12:04:17.421 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-08-16T12:04:17.478 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-08-16T12:04:17.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-08-16T12:04:17.611 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-08-16T12:04:17.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-08-16T12:04:17.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-08-16T12:04:17.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-08-16T12:04:17.848 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-08-16T12:04:17.903 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-08-16T12:04:17.904 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-08-16T12:04:17.904 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-08-16T12:04:17.904 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-08-16T12:04:17.904 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-08-16T12:04:17.904 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-08-16T12:04:17.904 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T12:04:17.905 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-08-16T12:04:17.905 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-08-16T12:04:17.905 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T12:04:17.905 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-08-16T12:04:17.905 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T12:04:17.905 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T12:04:17.905 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T12:04:17.906 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-08-16T12:04:17.906 DEBUG:teuthology.parallel:result is None 2023-08-16T12:04:18.050 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2023-08-16T12:04:18.051 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-16T12:04:18.077 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-08-16T12:04:18.078 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-16T12:04:18.103 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2023-08-16T12:04:18.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-08-16T12:04:18.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:04:18.202 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-08-16T12:04:18.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-08-16T12:04:18.387 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-08-16T12:04:18.441 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-08-16T12:04:18.441 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-08-16T12:04:18.496 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2023-08-16T12:04:18.496 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2023-08-16T12:04:18.496 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2023-08-16T12:04:18.496 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2023-08-16T12:04:18.497 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2023-08-16T12:04:18.497 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2023-08-16T12:04:18.497 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T12:04:18.497 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-08-16T12:04:18.497 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2023-08-16T12:04:18.497 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T12:04:18.497 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2023-08-16T12:04:18.498 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T12:04:18.498 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T12:04:18.498 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T12:04:18.498 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-08-16T12:04:18.518 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-08-16T12:04:18.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-08-16T12:04:18.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T12:04:18.642 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-08-16T12:04:18.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-08-16T12:04:18.713 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-08-16T12:04:18.768 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-08-16T12:04:18.769 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-08-16T12:04:18.824 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-08-16T12:04:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-08-16T12:04:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-08-16T12:04:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-08-16T12:04:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-08-16T12:04:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-08-16T12:04:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-16T12:04:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-08-16T12:04:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-08-16T12:04:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-16T12:04:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-08-16T12:04:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T12:04:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-16T12:04:18.826 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-16T12:04:18.827 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-08-16T12:04:18.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:04:18.942 INFO:teuthology.dispatcher.supervisor:Running job 7369669 2023-08-16T12:04:18.943 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369669 --name vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} -- /home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369669/orig.config.yaml 2023-08-16T12:04:18.946 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369669 2023-08-16T12:04:18.947 INFO:teuthology.dispatcher.supervisor:Job PID: 9345 2023-08-16T12:04:18.947 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-16T12:06:19.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:08:19.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:10:19.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:12:19.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:14:19.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:16:19.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:18:20.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:20:20.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:22:20.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:24:20.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:26:20.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T12:26:20.782 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-16T12:26:20.939 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-16T12:26:20.939 INFO:teuthology.nuke:Checking targets against current locks 2023-08-16T12:26:20.986 DEBUG:teuthology.nuke:shortname: smithi016 2023-08-16T12:26:20.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T12:26:21.009 DEBUG:teuthology.nuke:shortname: smithi151 2023-08-16T12:26:21.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T12:26:21.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369669', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 11:59:26.390323', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBuxMF/c5gffhMXA0kgZxqxBk9nofjdoOYHnWmWBd75W+k1iPf2Aajc/xA59KTjv4LzQkxu7yZ746+EbHp+TC4='} 2023-08-16T12:26:21.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369669', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 11:59:26.392033', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMD9JKyFF8uzRF+F2CZbpC3niRGFmOPMMBImxocm1D98zf5xLoYJuuzO7Yr+2GHcQt1nFDNrEao9ae0LIV39W4='} 2023-08-16T12:26:21.059 INFO:teuthology.orchestra.console.smithi016:Power off 2023-08-16T12:26:21.060 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T12:26:21.083 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-08-16T12:26:21.083 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T12:26:21.098 INFO:teuthology.orchestra.console.smithi151:Power off 2023-08-16T12:26:21.099 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T12:26:21.110 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-08-16T12:26:21.121 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-08-16T12:26:21.121 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T12:26:21.145 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-08-16T12:26:21.212 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-08-16T12:26:21.246 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-08-16T12:26:21.370 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2023-08-16T12:26:21.395 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com