2023-09-02T01:04:24.000 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-02T01:04:24.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:04:24.161 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8fc71eb670>, signals=[15]) 2023-09-02T01:04:24.163 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2023-09-02T01:04:24.163 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:04:24.163 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-09-02T01:04:24.184 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2023-09-02T01:04:24.184 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:04:24.184 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-09-02T01:04:24.186 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /host {"name": "smithi018"} 2023-09-02T01:04:24.209 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"} 2023-09-02T01:04:24.259 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-02T01:04:24.265 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-02T01:04:24.304 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10) 2023-09-02T01:04:24.304 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 10} 2023-09-02T01:04:24.307 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_centos_9.stream (ID 10) 2023-09-02T01:04:24.307 DEBUG:teuthology.provision.fog.smithi018:FOG request: PUT /host/124 {"imageID": 10} 2023-09-02T01:04:24.350 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream 2023-09-02T01:04:24.350 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:04:24.355 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 9.stream 2023-09-02T01:04:24.355 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:04:24.389 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:04:24.404 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:04:24.435 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1} 2023-09-02T01:04:24.449 DEBUG:teuthology.provision.fog.smithi018:FOG request: POST /host/124/task {"taskTypeID": 1} 2023-09-02T01:04:24.498 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:04:24.600 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:04:24.648 INFO:teuthology.orchestra.console.smithi066:Power off 2023-09-02T01:04:24.649 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:04:24.669 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-09-02T01:04:24.669 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:24.681 INFO:teuthology.orchestra.console.smithi018:Power off 2023-09-02T01:04:24.682 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:04:24.689 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-09-02T01:04:24.701 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2023-09-02T01:04:24.701 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:24.722 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2023-09-02T01:04:28.694 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:28.724 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:28.803 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-09-02T01:04:28.833 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2023-09-02T01:04:32.809 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:32.834 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:32.917 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-09-02T01:04:32.942 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2023-09-02T01:04:33.019 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-09-02T01:04:33.044 INFO:teuthology.orchestra.console.smithi018:Power off completed 2023-09-02T01:04:33.120 INFO:teuthology.orchestra.console.smithi066:Power on 2023-09-02T01:04:33.121 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:04:33.140 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2023-09-02T01:04:33.140 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:33.147 INFO:teuthology.orchestra.console.smithi018:Power on 2023-09-02T01:04:33.147 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:04:33.160 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-09-02T01:04:33.166 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On 2023-09-02T01:04:33.167 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:33.188 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2023-09-02T01:04:37.162 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:37.189 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:37.271 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-09-02T01:04:37.297 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2023-09-02T01:04:41.274 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:41.297 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:41.396 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-09-02T01:04:41.406 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2023-09-02T01:04:41.498 INFO:teuthology.orchestra.console.smithi066:Power on completed 2023-09-02T01:04:41.507 INFO:teuthology.orchestra.console.smithi018:Power on completed 2023-09-02T01:04:41.598 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2023-09-02T01:04:41.599 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:04:41.608 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2023-09-02T01:04:41.608 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:04:56.802 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:04:56.803 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:05:12.165 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:05:12.167 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:05:27.516 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:05:27.518 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:05:42.884 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:05:42.886 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:05:58.250 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:05:58.251 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:06:13.584 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:06:13.622 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:06:28.979 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:06:29.003 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:06:44.509 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:06:44.511 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:06:59.994 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:07:00.006 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:07:18.802 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:07:18.932 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:07:42.884 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-09-02T01:07:43.631 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:07:49.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:08:05.296 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:08:08.218 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-09-02T01:08:14.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:08:17.274 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-09-02T01:08:23.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:08:26.362 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-09-02T01:08:27.767 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:08:32.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:08:43.328 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:08:58.774 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:09:14.198 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:09:32.385 WARNING:teuthology.provision.fog.smithi018:timed out 2023-09-02T01:09:32.476 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:09:38.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:09:38.626 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:09:38.626 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:09:39.001 INFO:teuthology.provision.fog.smithi018:Node is ready 2023-09-02T01:09:39.002 DEBUG:teuthology.orchestra.run.smithi018:> hostname 2023-09-02T01:09:39.017 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2023-09-02T01:09:39.018 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts 2023-09-02T01:09:39.074 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2023-09-02T01:09:39.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-09-02T01:09:39.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts 2023-09-02T01:09:39.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts 2023-09-02T01:09:39.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname 2023-09-02T01:09:39.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-09-02T01:09:39.412 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-09-02T01:09:39.467 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2023-09-02T01:09:39.467 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2023-09-02T01:09:39.467 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2023-09-02T01:09:39.467 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:09:39.467 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2023-09-02T01:09:39.468 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:09:39.468 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:09:39.468 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2023-09-02T01:09:39.468 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:09:39.468 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:09:39.469 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:09:39.469 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:09:39.469 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:09:39.469 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:09:39.470 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2023-09-02T01:09:39.471 DEBUG:teuthology.parallel:result is None 2023-09-02T01:09:50.410 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:10:07.906 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:10:24.928 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-09-02T01:10:26.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:10:44.890 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:10:50.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:10:53.978 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:10:59.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:11:03.034 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:11:09.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:11:12.122 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:11:18.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:11:21.178 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:11:27.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:11:30.266 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:11:36.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:11:39.355 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:11:45.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:11:48.410 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-09-02T01:11:54.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:12:54.478 WARNING:teuthology.provision.fog.smithi066:timed out 2023-09-02T01:13:00.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:13:00.752 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:13:00.752 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:13:01.135 INFO:teuthology.provision.fog.smithi066:Node is ready 2023-09-02T01:13:01.135 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2023-09-02T01:13:01.151 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2023-09-02T01:13:01.151 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2023-09-02T01:13:01.206 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2023-09-02T01:13:01.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-09-02T01:13:01.316 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2023-09-02T01:13:01.348 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2023-09-02T01:13:01.419 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2023-09-02T01:13:01.490 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-09-02T01:13:01.560 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-09-02T01:13:01.616 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2023-09-02T01:13:01.616 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2023-09-02T01:13:01.616 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2023-09-02T01:13:01.616 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:13:01.617 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2023-09-02T01:13:01.617 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:13:01.617 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:13:01.617 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-09-02T01:13:01.617 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:13:01.618 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:13:01.618 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:13:01.618 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:13:01.618 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:13:01.618 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:13:01.619 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2023-09-02T01:13:01.620 DEBUG:teuthology.parallel:result is None 2023-09-02T01:13:01.789 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2023-09-02T01:13:01.790 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:13:01.812 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2023-09-02T01:13:01.812 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:13:01.830 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:13:01.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-09-02T01:13:01.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:13:01.928 DEBUG:teuthology.orchestra.run.smithi018:> true 2023-09-02T01:13:02.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-09-02T01:13:02.109 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2023-09-02T01:13:02.164 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2023-09-02T01:13:02.165 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-09-02T01:13:02.219 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2023-09-02T01:13:02.219 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2023-09-02T01:13:02.220 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2023-09-02T01:13:02.220 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:13:02.220 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2023-09-02T01:13:02.220 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:13:02.220 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:13:02.221 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2023-09-02T01:13:02.221 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:13:02.221 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:13:02.221 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:13:02.221 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:13:02.222 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:13:02.222 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:13:02.222 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-09-02T01:13:02.245 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:13:02.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-09-02T01:13:02.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:13:02.342 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-09-02T01:13:02.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-09-02T01:13:02.408 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-09-02T01:13:02.463 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-09-02T01:13:02.464 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-09-02T01:13:02.519 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2023-09-02T01:13:02.520 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2023-09-02T01:13:02.520 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2023-09-02T01:13:02.520 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:13:02.520 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2023-09-02T01:13:02.520 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:13:02.521 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:13:02.521 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-09-02T01:13:02.521 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:13:02.521 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:13:02.521 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:13:02.522 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:13:02.522 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:13:02.522 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:13:02.523 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-09-02T01:13:02.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:13:02.645 INFO:teuthology.dispatcher.supervisor:Running job 7386691 2023-09-02T01:13:02.646 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386691 --name pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} -- /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386691/orig.config.yaml 2023-09-02T01:13:02.649 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386691 2023-09-02T01:13:02.649 INFO:teuthology.dispatcher.supervisor:Job PID: 440907 2023-09-02T01:13:02.650 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-02T01:15:02.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:17:02.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:19:03.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:21:03.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:23:03.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:25:03.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:27:03.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:29:03.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:31:04.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:31:04.190 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-02T01:31:04.303 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-02T01:31:04.303 INFO:teuthology.nuke:Checking targets against current locks 2023-09-02T01:31:04.347 DEBUG:teuthology.nuke:shortname: smithi018 2023-09-02T01:31:04.347 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T01:31:04.366 DEBUG:teuthology.nuke:shortname: smithi066 2023-09-02T01:31:04.366 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T01:31:04.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386691', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:04:22.107309', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRUaVkmfNMJRB/3zlWGT09tu1pX9vx86Zln6zXHDm5V/JUo8MOiBEsrrb5DNSt+3sOtfSlaloVaDCfu5zIZuG1vDwZzI5NIhdKJAciXN1rCzT+LOL4YAM2stb9Vs4JQ2PvSTMfd16fqfl6adwjS4cIBvTGlK8PLhC140uz3VNbowXaldJCcUGSaYLXKfxB56iVEs5ln/49AjeBiJa8aPnKEkUaAjnlXS+tqCSzmgpQBefccJ2rFPA7bbMxdbrBehIyuIZX0TiR8fdWX4lWQBH9ttmmqT8vkHvNoKgBNosHGsGD3UWMeTu0QPq2gwxXGLBM2NvjsGWi2961dZ0KZikFbY17wfHXKi9w7eV0RndXtaWtJnBlhvKoZEBuvwa1lL5/94PUfh+DsLOlFNiEXmCxDzPS0snPwprNWsSe3shBEaJed+r8RLwLOmkt3Wcix2rhUd17aIPmIJNUyRT02x9qUAtNP+AOjR9PpfLMBeKVow62RmyU3hLZOnXrxMg8Zak='} 2023-09-02T01:31:04.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386691', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:04:22.109208', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNZA+CjOS2ZvULrh9omSjlaMocrC/Mc/evvI7fxk5dAZd2JKzGkAFH0rSP63B43tbYUv6UmM7E8eIsEkpI0uQPsRkimETamgoEedMf+QqQNwHFU3JNol9qj7DSU8VTiNxBQCzncbjgzxXqdplZLG8jDIskOOG86UE08Rst0nBpgJ1NdSmILVJL6pt/+fPgMQMLRMvyAbTucMLkHfayj7JS1/ajWJDCx8H4jf9E2Us+hFf3dF0W0JMDA8YKwvwXWbmvBNKW/cI5ukiS+hQHHL4G+WJKLiPFmUcLaldi09vGJLT0xxVdE1NJxX5Ip2pNazsycvz4qWCkn83I2SFYxtusinNP0rGSC0wLY+i5WtANRXadCWVFFF3LZH0i/00/JqCSiEZvZzcA/fE0WHdFPpeLWvrukMsHbX6XweISdCByEqRr6q4BHAUEAwwRLBC2lTeK+KWLspVoJmXfKMkWkWzHTav4/ZykKxbMc6+scolzEdHf0yDlw+HFkL54vTGTusc='} 2023-09-02T01:31:04.420 INFO:teuthology.orchestra.console.smithi018:Power off 2023-09-02T01:31:04.421 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:31:04.443 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2023-09-02T01:31:04.444 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:31:04.456 INFO:teuthology.orchestra.console.smithi066:Power off 2023-09-02T01:31:04.457 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:31:04.465 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2023-09-02T01:31:04.477 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-09-02T01:31:04.478 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:31:04.500 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-09-02T01:31:04.567 INFO:teuthology.orchestra.console.smithi018:Power off completed 2023-09-02T01:31:04.602 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-09-02T01:31:04.723 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2023-09-02T01:31:04.748 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com