2023-08-04T14:35:44.272 INFO:root:teuthology version: 0.0.1.dev180+g8b927ac 2023-08-04T14:35:44.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:35:44.424 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc8cec3f70>, signals=[15]) 2023-08-04T14:35:44.425 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-08-04T14:35:44.426 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-08-04T14:35:44.426 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-04T14:35:44.450 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-08-04T14:35:44.451 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-08-04T14:35:44.451 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-04T14:35:44.453 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-08-04T14:35:44.475 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-08-04T14:35:44.534 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-04T14:35:44.537 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-04T14:35:44.584 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-04T14:35:44.584 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 5} 2023-08-04T14:35:44.587 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-04T14:35:44.588 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 5} 2023-08-04T14:35:44.628 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6 2023-08-04T14:35:44.628 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:35:44.630 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6 2023-08-04T14:35:44.631 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:35:44.669 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-08-04T14:35:44.672 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-08-04T14:35:44.711 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-08-04T14:35:44.714 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-08-04T14:35:44.758 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:35:44.768 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:35:44.840 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-04T14:35:44.840 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T14:35:44.857 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-04T14:35:44.858 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T14:35:44.866 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-04T14:35:44.867 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:44.878 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-04T14:35:44.879 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:44.889 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-04T14:35:44.901 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-04T14:35:48.893 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:48.903 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:49.004 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-04T14:35:49.013 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-04T14:35:53.008 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:53.016 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:53.118 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-04T14:35:53.127 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-04T14:35:53.228 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-04T14:35:53.328 INFO:teuthology.orchestra.console.smithi179:Power on 2023-08-04T14:35:53.329 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-04T14:35:53.350 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-08-04T14:35:53.350 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:53.371 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-04T14:35:57.122 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:57.231 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-04T14:35:57.332 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-04T14:35:57.373 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:57.434 INFO:teuthology.orchestra.console.smithi079:Power on 2023-08-04T14:35:57.434 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-04T14:35:57.454 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-08-04T14:35:57.455 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:35:57.474 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-04T14:35:57.482 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-04T14:36:01.476 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:36:01.484 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T14:36:01.586 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-04T14:36:01.594 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-04T14:36:01.688 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-08-04T14:36:01.695 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-08-04T14:36:01.789 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-08-04T14:36:01.790 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:36:01.796 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-08-04T14:36:01.797 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:36:16.856 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:36:16.857 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:36:31.923 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:36:31.924 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:36:47.005 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:36:47.007 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:37:02.072 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:37:02.074 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:37:17.136 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:37:17.138 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:37:32.202 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:37:32.203 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:37:47.272 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:37:47.273 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:38:02.331 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:38:02.332 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:38:17.410 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:38:17.411 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:38:32.475 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:38:32.476 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:38:47.544 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-04T14:38:47.545 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-04T14:38:47.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:38:47.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:06.100 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-04T14:39:06.101 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-04T14:39:12.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:12.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:15.184 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-04T14:39:15.185 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-04T14:39:21.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:21.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:24.244 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-04T14:39:24.246 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-04T14:39:30.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:30.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:33.328 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-04T14:39:33.329 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-04T14:39:39.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:39.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:39:42.416 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-04T14:39:48.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:40:39.384 WARNING:teuthology.provision.fog.smithi179:timed out 2023-08-04T14:40:45.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:40:45.609 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-04T14:40:45.609 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-04T14:40:45.890 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-08-04T14:40:45.890 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-08-04T14:40:45.909 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2023-08-04T14:40:45.909 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2023-08-04T14:40:45.965 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-08-04T14:40:45.966 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-04T14:40:46.096 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2023-08-04T14:40:46.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-08-04T14:40:46.191 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2023-08-04T14:40:46.255 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-04T14:40:46.321 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-04T14:40:46.376 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-08-04T14:40:46.376 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-08-04T14:40:46.376 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-08-04T14:40:46.376 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-08-04T14:40:46.376 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T14:40:46.377 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-08-04T14:40:46.378 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T14:40:46.378 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-04T14:40:46.378 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-04T14:40:46.378 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-04T14:40:46.379 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-08-04T14:40:46.380 DEBUG:teuthology.parallel:result is None 2023-08-04T14:40:48.427 WARNING:teuthology.provision.fog.smithi079:timed out 2023-08-04T14:40:54.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:40:54.793 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-04T14:40:54.793 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-04T14:40:55.062 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-08-04T14:40:55.062 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-08-04T14:40:55.079 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 2023-08-04T14:40:55.079 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079 /etc/hosts 2023-08-04T14:40:55.136 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-08-04T14:40:55.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-04T14:40:55.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079/smithi079/g' /etc/hosts 2023-08-04T14:40:55.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-08-04T14:40:55.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079/smithi079/g' /etc/hostname 2023-08-04T14:40:55.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-04T14:40:55.485 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-04T14:40:55.541 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-04T14:40:55.541 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-08-04T14:40:55.542 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-04T14:40:55.542 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-04T14:40:55.542 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-08-04T14:40:55.542 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-04T14:40:55.542 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-04T14:40:55.542 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-04T14:40:55.542 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-04T14:40:55.543 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-04T14:40:55.543 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-04T14:40:55.543 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T14:40:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-04T14:40:55.543 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T14:40:55.543 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-04T14:40:55.543 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-04T14:40:55.544 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-04T14:40:55.544 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-08-04T14:40:55.544 DEBUG:teuthology.parallel:result is None 2023-08-04T14:40:55.682 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-08-04T14:40:55.682 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-04T14:40:55.705 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-08-04T14:40:55.705 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-04T14:40:55.724 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-08-04T14:40:55.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-04T14:40:55.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:40:55.790 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-08-04T14:40:55.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-04T14:40:55.857 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-08-04T14:40:55.912 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-08-04T14:40:55.912 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-04T14:40:55.968 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-04T14:40:55.968 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-08-04T14:40:55.968 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-04T14:40:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-04T14:40:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-08-04T14:40:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-04T14:40:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-04T14:40:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-04T14:40:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-04T14:40:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-04T14:40:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-04T14:40:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T14:40:55.970 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-04T14:40:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T14:40:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-04T14:40:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-04T14:40:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-04T14:40:55.971 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-04T14:40:55.988 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-08-04T14:40:55.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-04T14:40:55.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T14:40:56.054 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-08-04T14:40:56.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-04T14:40:56.128 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-08-04T14:40:56.187 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-08-04T14:40:56.187 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-04T14:40:56.246 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-08-04T14:40:56.246 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-08-04T14:40:56.247 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-08-04T14:40:56.247 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-08-04T14:40:56.247 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-08-04T14:40:56.247 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-08-04T14:40:56.247 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-04T14:40:56.248 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-04T14:40:56.248 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-04T14:40:56.248 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-08-04T14:40:56.248 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-04T14:40:56.248 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T14:40:56.248 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-08-04T14:40:56.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T14:40:56.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-04T14:40:56.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-04T14:40:56.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-04T14:40:56.249 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-04T14:40:56.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:40:56.355 INFO:teuthology.dispatcher.supervisor:Running job 7360376 2023-08-04T14:40:56.355 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8b927acc9e717d32e281866f887eb54ec8b597d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-04_14:30:08-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7360376 --name pdonnell-2023-08-04_14:30:08-fs-wip-batrick-testing-20230803.140718-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} -- /home/teuthworker/archive/pdonnell-2023-08-04_14:30:08-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7360376/orig.config.yaml 2023-08-04T14:40:56.359 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-04_14:30:08-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7360376 2023-08-04T14:40:56.360 INFO:teuthology.dispatcher.supervisor:Job PID: 3966 2023-08-04T14:40:56.360 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-04T14:42:56.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:44:56.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:46:56.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:48:56.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:50:57.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:52:57.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:54:57.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:56:57.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T14:58:57.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T15:00:57.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T15:00:57.772 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-04T15:00:57.888 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-04T15:00:57.888 INFO:teuthology.nuke:Checking targets against current locks 2023-08-04T15:00:57.935 DEBUG:teuthology.nuke:shortname: smithi079 2023-08-04T15:00:57.936 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-04T15:00:57.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-04_14:30:08-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7360376', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-04 14:35:43.468427', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-04T15:00:57.958 DEBUG:teuthology.nuke:shortname: smithi179 2023-08-04T15:00:57.959 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-04T15:00:57.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-04_14:30:08-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7360376', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-04 14:35:43.470130', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-04T15:00:58.003 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-04T15:00:58.003 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T15:00:58.023 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-04T15:00:58.023 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T15:00:58.041 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-04T15:00:58.041 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T15:00:58.050 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-04T15:00:58.061 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-04T15:00:58.061 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T15:00:58.081 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-04T15:00:58.152 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-04T15:00:58.182 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-04T15:00:58.297 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-08-04T15:00:58.330 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com