2023-08-25T03:15:24.714 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T03:15:24.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:15:24.853 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5db9c23f70>, signals=[15]) 2023-08-25T03:15:24.855 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-08-25T03:15:24.855 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T03:15:24.856 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-08-25T03:15:24.882 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-08-25T03:15:24.882 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T03:15:24.882 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-08-25T03:15:24.884 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-08-25T03:15:24.907 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-08-25T03:15:24.955 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T03:15:24.969 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T03:15:25.004 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T03:15:25.005 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 5} 2023-08-25T03:15:25.023 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T03:15:25.023 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 5} 2023-08-25T03:15:25.048 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of rhel 8.6 2023-08-25T03:15:25.049 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:15:25.068 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6 2023-08-25T03:15:25.068 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:15:25.106 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T03:15:25.121 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T03:15:25.146 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-08-25T03:15:25.159 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-08-25T03:15:25.190 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:15:25.215 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:15:25.292 INFO:teuthology.orchestra.console.smithi002:Power off 2023-08-25T03:15:25.293 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T03:15:25.310 INFO:teuthology.orchestra.console.smithi031:Power off 2023-08-25T03:15:25.310 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T03:15:25.319 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-08-25T03:15:25.320 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:25.333 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-08-25T03:15:25.333 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:25.342 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-08-25T03:15:25.354 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-08-25T03:15:29.345 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:29.355 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:29.456 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-08-25T03:15:29.465 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-08-25T03:15:33.460 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:33.468 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:33.570 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-25T03:15:33.579 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-08-25T03:15:33.671 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-08-25T03:15:33.772 INFO:teuthology.orchestra.console.smithi002:Power on 2023-08-25T03:15:33.773 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T03:15:33.794 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-08-25T03:15:33.795 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:33.818 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-25T03:15:37.580 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:37.691 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-08-25T03:15:37.792 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-08-25T03:15:37.819 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:37.894 INFO:teuthology.orchestra.console.smithi031:Power on 2023-08-25T03:15:37.895 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T03:15:37.915 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-08-25T03:15:37.916 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:37.930 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-25T03:15:37.939 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-08-25T03:15:41.932 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:41.941 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:42.044 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-08-25T03:15:42.052 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-08-25T03:15:42.145 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-08-25T03:15:42.246 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-08-25T03:15:42.246 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:15:46.056 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:15:46.170 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-08-25T03:15:46.271 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-08-25T03:15:46.371 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-08-25T03:15:46.372 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:15:57.316 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:16:01.440 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:16:12.404 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:16:16.512 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:16:27.492 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:16:31.588 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:16:42.576 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:16:46.672 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:16:57.648 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:17:01.756 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:17:12.724 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:17:16.831 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:17:27.796 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:17:31.912 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:17:42.884 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:17:46.984 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:17:57.968 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:18:02.072 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-08-25T03:18:02.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:18:02.269 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-08-25T03:18:02.272 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T03:18:02.274 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T03:18:02.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-25T03:18:03.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-25T03:18:13.042 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-25T03:18:13.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:18:16.176 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-25T03:18:22.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:18:25.232 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-25T03:18:31.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:18:34.288 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-25T03:18:40.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:18:43.344 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-25T03:18:49.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:18:52.400 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-25T03:18:58.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:19:01.456 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-25T03:19:07.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:19:55.248 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-25T03:19:55.250 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi031 2023-08-25T03:20:04.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-08-25T03:20:04.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:20:04.599 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-08-25T03:20:04.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-08-25T03:20:04.880 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T03:20:04.880 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T03:20:04.898 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-08-25T03:20:04.898 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-08-25T03:20:04.957 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-08-25T03:20:04.958 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-08-25T03:20:05.015 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-08-25T03:20:05.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-08-25T03:20:05.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-08-25T03:20:05.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-08-25T03:20:05.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-08-25T03:20:05.317 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-08-25T03:20:05.389 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-08-25T03:20:05.446 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T03:20:05.447 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T03:20:05.447 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-08-25T03:20:05.447 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-08-25T03:20:05.448 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-08-25T03:20:05.448 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-08-25T03:20:05.448 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T03:20:05.448 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-08-25T03:20:05.448 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T03:20:05.449 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T03:20:05.450 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T03:20:05.451 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T03:20:05.451 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-08-25T03:20:05.451 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T03:20:05.451 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T03:20:05.451 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T03:20:05.451 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T03:20:05.452 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-08-25T03:20:05.454 DEBUG:teuthology.parallel:result is None 2023-08-25T03:20:07.462 WARNING:teuthology.provision.fog.smithi002:timed out 2023-08-25T03:20:13.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:20:13.788 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T03:20:13.789 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T03:20:14.063 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-08-25T03:20:14.064 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-08-25T03:20:14.083 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-08-25T03:20:14.083 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-08-25T03:20:14.142 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-08-25T03:20:14.143 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-08-25T03:20:14.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-08-25T03:20:14.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-08-25T03:20:14.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-08-25T03:20:14.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-08-25T03:20:14.490 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-08-25T03:20:14.548 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T03:20:14.548 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T03:20:14.549 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2023-08-25T03:20:14.549 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2023-08-25T03:20:14.549 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2023-08-25T03:20:14.549 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-08-25T03:20:14.550 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T03:20:14.550 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-08-25T03:20:14.550 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T03:20:14.551 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T03:20:14.551 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T03:20:14.551 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T03:20:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-08-25T03:20:14.552 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T03:20:14.552 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T03:20:14.553 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T03:20:14.553 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T03:20:14.554 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-08-25T03:20:14.554 DEBUG:teuthology.parallel:result is None 2023-08-25T03:20:14.744 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-08-25T03:20:14.745 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T03:20:14.765 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-08-25T03:20:14.766 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T03:20:14.792 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-08-25T03:20:14.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-08-25T03:20:14.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:20:14.862 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-08-25T03:20:14.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-08-25T03:20:14.932 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-08-25T03:20:14.991 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-08-25T03:20:14.992 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-08-25T03:20:15.051 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T03:20:15.051 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T03:20:15.051 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2023-08-25T03:20:15.051 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2023-08-25T03:20:15.052 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2023-08-25T03:20:15.052 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-08-25T03:20:15.052 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T03:20:15.052 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-08-25T03:20:15.052 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T03:20:15.052 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T03:20:15.053 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T03:20:15.053 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T03:20:15.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-08-25T03:20:15.053 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T03:20:15.053 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T03:20:15.053 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T03:20:15.053 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T03:20:15.054 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-08-25T03:20:15.074 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-08-25T03:20:15.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-08-25T03:20:15.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:20:15.145 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-08-25T03:20:15.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-08-25T03:20:15.218 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-08-25T03:20:15.276 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-08-25T03:20:15.277 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-08-25T03:20:15.337 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T03:20:15.338 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T03:20:15.338 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-08-25T03:20:15.338 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-08-25T03:20:15.338 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-08-25T03:20:15.339 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-08-25T03:20:15.339 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T03:20:15.339 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-08-25T03:20:15.339 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T03:20:15.339 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T03:20:15.340 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T03:20:15.340 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T03:20:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-08-25T03:20:15.340 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T03:20:15.341 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T03:20:15.341 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T03:20:15.344 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T03:20:15.344 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-08-25T03:20:15.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:20:15.463 INFO:teuthology.dispatcher.supervisor:Running job 7379011 2023-08-25T03:20:15.463 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379011 --name rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379011/orig.config.yaml 2023-08-25T03:20:15.472 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379011 2023-08-25T03:20:15.473 INFO:teuthology.dispatcher.supervisor:Job PID: 27799 2023-08-25T03:20:15.473 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-25T03:22:15.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:24:15.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:26:15.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:28:16.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:30:16.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:32:16.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:34:16.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:36:16.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:38:16.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:38:17.011 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-25T03:38:17.205 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-25T03:38:17.205 INFO:teuthology.nuke:Checking targets against current locks 2023-08-25T03:38:17.256 DEBUG:teuthology.nuke:shortname: smithi002 2023-08-25T03:38:17.257 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T03:38:17.279 DEBUG:teuthology.nuke:shortname: smithi031 2023-08-25T03:38:17.280 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T03:38:17.285 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379011', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 03:15:23.904500', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-25T03:38:17.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379011', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 03:15:23.906528', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-25T03:38:17.333 INFO:teuthology.orchestra.console.smithi002:Power off 2023-08-25T03:38:17.334 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T03:38:17.352 INFO:teuthology.orchestra.console.smithi031:Power off 2023-08-25T03:38:17.353 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T03:38:17.362 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-08-25T03:38:17.363 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:38:17.374 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-08-25T03:38:17.374 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T03:38:17.385 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-25T03:38:17.398 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-08-25T03:38:17.487 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-08-25T03:38:17.499 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-08-25T03:38:17.635 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-08-25T03:38:17.652 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com