2023-12-14T16:01:40.389 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T16:01:40.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:01:40.533 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2036858940>, signals=[15]) 2023-12-14T16:01:40.533 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2023-12-14T16:01:40.534 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T16:01:40.534 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-12-14T16:01:40.562 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-12-14T16:01:40.562 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T16:01:40.562 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-14T16:01:40.685 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T16:01:40.705 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T16:01:40.747 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.4 2023-12-14T16:01:40.754 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.4 2023-12-14T16:01:41.083 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-14T16:01:41.084 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:01:41.102 INFO:teuthology.orchestra.console.smithi067:Power off 2023-12-14T16:01:41.102 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:01:41.111 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-14T16:01:41.111 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:01:41.130 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-12-14T16:01:41.130 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:01:41.147 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-14T16:01:41.156 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-12-14T16:01:41.248 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-14T16:01:41.257 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-12-14T16:01:41.349 INFO:teuthology.orchestra.console.smithi157:Power on 2023-12-14T16:01:41.350 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T16:01:41.357 INFO:teuthology.orchestra.console.smithi067:Power on 2023-12-14T16:01:41.357 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T16:01:41.371 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-12-14T16:01:41.372 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:01:41.382 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2023-12-14T16:01:41.382 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:01:41.399 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-14T16:01:41.407 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-12-14T16:01:45.401 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:01:45.409 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:01:45.512 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-14T16:01:45.519 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-12-14T16:01:45.619 INFO:teuthology.orchestra.console.smithi067:Power on completed 2023-12-14T16:01:45.720 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2023-12-14T16:01:49.515 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:01:49.624 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-14T16:01:49.725 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-12-14T16:01:49.826 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-12-14T16:04:32.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:04:35.089 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:04:41.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:04:44.149 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:04:50.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:04:53.237 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:04:59.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:02.325 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:05:06.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:08.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:11.409 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:05:17.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:20.470 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:05:24.626 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:05:26.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:29.553 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:05:30.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:33.682 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:05:35.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:38.609 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-14T16:05:39.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:42.741 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:05:44.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:48.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:05:51.825 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:05:57.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:06:00.881 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:06:06.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:06:09.942 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:06:15.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:06:34.514 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:06:40.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:06:43.569 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:06:44.620 WARNING:teuthology.provision.fog.smithi067:timed out 2023-12-14T16:06:49.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:06:50.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:06:50.911 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T16:06:50.912 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T16:06:51.202 INFO:teuthology.provision.fog.smithi067:Node is ready 2023-12-14T16:06:51.203 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2023-12-14T16:06:51.218 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2023-12-14T16:06:51.219 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2023-12-14T16:06:51.274 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2023-12-14T16:06:51.275 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-12-14T16:06:51.392 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2023-12-14T16:06:51.419 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2023-12-14T16:06:51.485 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2023-12-14T16:06:51.550 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-12-14T16:06:51.614 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-12-14T16:06:51.669 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:06:51.670 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:06:51.670 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-12-14T16:06:51.670 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-12-14T16:06:51.671 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-12-14T16:06:51.671 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:06:51.671 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:06:51.671 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-12-14T16:06:51.672 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:06:51.672 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:06:51.672 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:06:51.672 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:06:51.673 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-14T16:06:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:06:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:06:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:06:51.674 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:06:51.674 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2023-12-14T16:06:51.676 DEBUG:teuthology.parallel:result is None 2023-12-14T16:06:52.629 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-14T16:06:58.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:06:58.942 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T16:06:58.943 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T16:07:19.209 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-12-14T16:07:19.209 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-12-14T16:07:19.226 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-12-14T16:07:19.226 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-12-14T16:07:19.283 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-12-14T16:07:19.283 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-14T16:07:19.432 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-12-14T16:07:19.456 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-12-14T16:07:19.521 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-12-14T16:07:19.586 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-14T16:07:19.649 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-14T16:07:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:07:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:07:19.704 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-14T16:07:19.705 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:07:19.705 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:07:19.705 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:07:19.705 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:07:19.705 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-12-14T16:07:19.705 DEBUG:teuthology.parallel:result is None 2023-12-14T16:07:19.888 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2023-12-14T16:07:19.889 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T16:07:19.911 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-12-14T16:07:19.911 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T16:07:19.929 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2023-12-14T16:07:19.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-14T16:07:19.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:07:20.001 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-12-14T16:07:20.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-14T16:07:20.121 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-12-14T16:07:20.177 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-12-14T16:07:20.177 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-12-14T16:07:20.233 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:07:20.233 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:07:20.233 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-12-14T16:07:20.233 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:07:20.234 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:07:20.237 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-12-14T16:07:20.261 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-12-14T16:07:20.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-14T16:07:20.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:07:20.326 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-12-14T16:07:20.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-14T16:07:20.396 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-12-14T16:07:20.449 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-12-14T16:07:20.449 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-14T16:07:20.505 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:07:20.506 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:07:20.506 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-14T16:07:20.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:07:20.643 INFO:teuthology.dispatcher.supervisor:Running job 7491393 2023-12-14T16:07:20.643 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491393 --name yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} -- /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491393/orig.config.yaml 2023-12-14T16:07:20.647 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491393 2023-12-14T16:07:20.647 INFO:teuthology.dispatcher.supervisor:Job PID: 815062 2023-12-14T16:07:20.647 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T16:09:20.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:11:20.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:13:21.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:15:21.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:17:21.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:17:21.516 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T16:17:21.633 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T16:17:21.634 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T16:17:21.685 DEBUG:teuthology.nuke:shortname: smithi067 2023-12-14T16:17:21.685 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T16:17:21.708 DEBUG:teuthology.nuke:shortname: smithi157 2023-12-14T16:17:21.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T16:17:21.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 16:01:39.531616', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbIdOeE0JhGC0NXTPtM+tYg/n+dFsLb1mVegku1H2a+xZZQkI6WM7hiczeC/nxlQjfqbYdNwBAjNx7HCHEG4mU='} 2023-12-14T16:17:21.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 16:01:39.533052', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByXKTaCWetJc5qhuYSk/Y7bdq+lGMYuLcvE6TVcQ8iMdKqadaMiJQJuLoJeX4dnNRWXapb87IU6dpMGa9SrjNw='} 2023-12-14T16:17:21.766 INFO:teuthology.orchestra.console.smithi067:Power off 2023-12-14T16:17:21.766 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:17:21.789 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-12-14T16:17:21.790 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:17:21.807 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-14T16:17:21.807 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:17:21.818 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-12-14T16:17:21.835 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-14T16:17:21.836 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:17:21.864 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-14T16:17:21.920 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-12-14T16:17:21.965 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-14T16:17:22.072 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2023-12-14T16:17:22.112 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com