2023-08-15T04:17:33.417 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T04:17:33.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:17:33.566 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2bd3211f70>, signals=[15]) 2023-08-15T04:17:33.568 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-08-15T04:17:33.568 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T04:17:33.569 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-08-15T04:17:33.593 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-08-15T04:17:33.594 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T04:17:33.594 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-08-15T04:17:33.595 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-08-15T04:17:33.619 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-08-15T04:17:33.680 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T04:17:33.691 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T04:17:33.725 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T04:17:33.725 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 7} 2023-08-15T04:17:33.738 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T04:17:33.739 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 7} 2023-08-15T04:17:33.770 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.4 2023-08-15T04:17:33.770 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:17:33.783 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.4 2023-08-15T04:17:33.783 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:17:33.817 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T04:17:33.846 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T04:17:33.856 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-08-15T04:17:33.883 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-08-15T04:17:33.908 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:17:33.936 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:17:34.006 INFO:teuthology.orchestra.console.smithi188:Power off 2023-08-15T04:17:34.007 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T04:17:34.023 INFO:teuthology.orchestra.console.smithi195:Power off 2023-08-15T04:17:34.024 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T04:17:34.034 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-08-15T04:17:34.035 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:34.046 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-08-15T04:17:34.046 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:34.057 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-15T04:17:34.071 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-08-15T04:17:38.060 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:38.072 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:38.172 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-15T04:17:38.184 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-08-15T04:17:42.176 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:42.187 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:42.289 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-15T04:17:42.296 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-08-15T04:17:42.397 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-08-15T04:17:42.497 INFO:teuthology.orchestra.console.smithi195:Power on 2023-08-15T04:17:42.498 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T04:17:42.521 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-08-15T04:17:42.521 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:42.543 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-08-15T04:17:46.293 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:46.404 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-15T04:17:46.505 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-08-15T04:17:46.545 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:46.606 INFO:teuthology.orchestra.console.smithi188:Power on 2023-08-15T04:17:46.607 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T04:17:46.654 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-08-15T04:17:46.655 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2023-08-15T04:17:46.655 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:46.686 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-15T04:17:50.659 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:50.687 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:50.769 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-08-15T04:17:50.798 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-15T04:17:50.871 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-08-15T04:17:50.972 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-08-15T04:17:50.973 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:17:54.800 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:17:54.911 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-15T04:17:55.013 INFO:teuthology.orchestra.console.smithi188:Power on completed 2023-08-15T04:17:55.113 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-08-15T04:17:55.114 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:18:06.044 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:18:10.190 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:18:21.124 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:18:25.260 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:18:36.204 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:18:40.324 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:18:51.296 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:18:55.409 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:19:06.376 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:19:10.476 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:19:21.460 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:19:25.554 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:19:36.544 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:19:40.628 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:19:51.630 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:19:55.724 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:20:06.716 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:20:10.816 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:20:21.800 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:20:25.904 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:20:36.916 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-08-15T04:20:36.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:20:40.048 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-08-15T04:20:41.015 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-15T04:20:41.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:20:44.176 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-15T04:20:46.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:20:49.104 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-08-15T04:20:50.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:20:53.232 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-15T04:20:55.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:20:58.160 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-08-15T04:20:59.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:21:02.288 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-15T04:21:04.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:21:07.216 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-08-15T04:21:08.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:21:11.348 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-15T04:21:13.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:21:16.272 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-08-15T04:21:17.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:21:20.432 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-15T04:21:22.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:21:26.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:21:29.488 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-15T04:21:35.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:22:22.321 WARNING:teuthology.provision.fog.smithi195:timed out 2023-08-15T04:22:28.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:22:28.616 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T04:22:28.617 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T04:22:28.964 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-08-15T04:22:28.965 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-08-15T04:22:28.978 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195 2023-08-15T04:22:28.978 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195 /etc/hosts 2023-08-15T04:22:29.032 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-08-15T04:22:29.032 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-08-15T04:22:29.149 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195/smithi195/g' /etc/hosts 2023-08-15T04:22:29.176 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-08-15T04:22:29.240 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195/smithi195/g' /etc/hostname 2023-08-15T04:22:29.304 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-08-15T04:22:29.371 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-08-15T04:22:29.425 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:22:29.426 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:22:29.426 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-08-15T04:22:29.426 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-08-15T04:22:29.427 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-08-15T04:22:29.427 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:22:29.428 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:22:29.428 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-08-15T04:22:29.428 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:22:29.429 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:22:29.429 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:22:29.429 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:22:29.429 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-15T04:22:29.430 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:22:29.430 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:22:29.430 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:22:29.430 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:22:29.431 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-08-15T04:22:29.433 DEBUG:teuthology.parallel:result is None 2023-08-15T04:22:35.496 WARNING:teuthology.provision.fog.smithi188:timed out 2023-08-15T04:22:41.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:22:41.780 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T04:22:41.780 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T04:22:42.078 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-08-15T04:22:42.079 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-08-15T04:22:42.094 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-08-15T04:22:42.094 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-08-15T04:22:42.149 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-08-15T04:22:42.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-08-15T04:22:42.259 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-08-15T04:22:42.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-08-15T04:22:42.348 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-08-15T04:22:42.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-08-15T04:22:42.475 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-08-15T04:22:42.529 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:22:42.529 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.4" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:22:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:22:42.531 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:22:42.531 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:22:42.531 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-15T04:22:42.531 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:22:42.531 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:22:42.531 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:22:42.531 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:22:42.532 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-08-15T04:22:42.532 DEBUG:teuthology.parallel:result is None 2023-08-15T04:22:42.690 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-08-15T04:22:42.691 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T04:22:42.715 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-08-15T04:22:42.715 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T04:22:42.733 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-08-15T04:22:42.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-08-15T04:22:42.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:22:42.800 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-08-15T04:22:42.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-08-15T04:22:42.862 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-08-15T04:22:42.916 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-08-15T04:22:42.916 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-08-15T04:22:42.970 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:22:42.970 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:22:42.970 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-08-15T04:22:42.971 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-08-15T04:22:42.971 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.4" 2023-08-15T04:22:42.971 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:22:42.971 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:22:42.971 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-08-15T04:22:42.971 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:22:42.971 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:22:42.972 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:22:42.972 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:22:42.972 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-15T04:22:42.972 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:22:42.972 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:22:42.972 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:22:42.972 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:22:42.973 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-08-15T04:22:42.990 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-08-15T04:22:42.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-08-15T04:22:42.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:22:43.061 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-08-15T04:22:43.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-08-15T04:22:43.183 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-08-15T04:22:43.237 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-08-15T04:22:43.238 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-08-15T04:22:43.293 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:22:43.293 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:22:43.294 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-08-15T04:22:43.294 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-08-15T04:22:43.294 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-08-15T04:22:43.295 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:22:43.295 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:22:43.295 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-08-15T04:22:43.295 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:22:43.296 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:22:43.296 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:22:43.296 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:22:43.296 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-15T04:22:43.296 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:22:43.297 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:22:43.297 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:22:43.297 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:22:43.298 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-08-15T04:22:43.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:22:43.421 INFO:teuthology.dispatcher.supervisor:Running job 7367809 2023-08-15T04:22:43.422 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367809 --name yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367809/orig.config.yaml 2023-08-15T04:22:43.425 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367809 2023-08-15T04:22:43.426 INFO:teuthology.dispatcher.supervisor:Job PID: 5378 2023-08-15T04:22:43.426 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-15T04:24:43.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:26:43.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:28:43.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:30:44.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:32:44.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:34:44.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:36:44.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:38:44.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:40:44.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:42:45.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:44:47.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:46:47.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:48:47.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:50:47.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:52:47.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:54:48.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:56:48.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:58:48.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:00:48.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:02:48.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:04:48.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:06:49.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:08:49.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:10:49.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:12:49.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:14:49.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:16:49.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:18:50.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T05:18:50.226 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-15T05:18:50.435 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-15T05:18:50.436 INFO:teuthology.nuke:Checking targets against current locks 2023-08-15T05:18:50.484 DEBUG:teuthology.nuke:shortname: smithi188 2023-08-15T05:18:50.484 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T05:18:50.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367809', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 04:17:32.614009', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDyU1I2gJLvCZICjB0iure+fxGD1Jd2+XBrc2WN9oEXzIbCDRAXRZhMTtZew7v1mMqwhnEGmPbQA2GjwMmxVeTO7dNBvH7UWSaRv5e1oi0LZaw8BSF+Upm7LSgRGyUw6OE/VfY3lw6U8n8LnTTR0LhfxJ/YbbR1qDO3/AYlSPwJmxOGdaDj/4J2o3aMNMYtDIr2kvDzan8rIZF4NUwTI4mpK+DRw4Drhd9i/y+q/qsZetG/00s0yrBtac5XIR4O75zZl2pOGVZdDoU0r2Qofvao6iHscb2rkYhcxBITeIYD4xLtbChDtq0OfjhHf2OfbCHLcAeLiPOKwkc56BhJNWOuedIOjN5v+oWhejNMspI0/PD6/F6RcdYv+b5qy8buaaCDq4A2+NTXFpFK+6SKqZgkj7lmP2y21tS8YtElltL/qMrHdkAAcGLCH6cER0SpaSdoEzM+SVOMOddTv1C5Q4CODfKYz5W9u4f7eFHXZGGBZFwDIUvR6LOGzxPOynV9Kc8='} 2023-08-15T05:18:50.515 DEBUG:teuthology.nuke:shortname: smithi195 2023-08-15T05:18:50.516 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T05:18:50.541 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367809', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 04:17:32.615621', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXxq9lkeuosMCMCa+7A/8j8Cs/ybkbA1aFabSGZWN+Xaom2PPjxBCodXtbULT0kk1A1EhCxDJylMwpAuNKWFvg='} 2023-08-15T05:18:50.571 INFO:teuthology.orchestra.console.smithi188:Power off 2023-08-15T05:18:50.572 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T05:18:50.597 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-08-15T05:18:50.598 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T05:18:50.615 INFO:teuthology.orchestra.console.smithi195:Power off 2023-08-15T05:18:50.616 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T05:18:50.627 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-15T05:18:50.647 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-08-15T05:18:50.647 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T05:18:50.685 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-08-15T05:18:50.729 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-08-15T05:18:50.788 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-08-15T05:18:50.881 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com 2023-08-15T05:18:50.939 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com