2023-12-14T21:32:31.906 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T21:32:31.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:32:32.070 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8604526940>, signals=[15]) 2023-12-14T21:32:32.071 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2023-12-14T21:32:32.071 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T21:32:32.071 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-12-14T21:32:32.093 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-12-14T21:32:32.093 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T21:32:32.093 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-12-14T21:32:32.109 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-12-14T21:32:32.109 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T21:32:32.110 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-12-14T21:32:32.206 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-14T21:32:32.232 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-14T21:32:32.235 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-14T21:32:32.246 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.6 2023-12-14T21:32:32.272 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of rhel 8.6 2023-12-14T21:32:32.285 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of rhel 8.6 2023-12-14T21:32:32.594 INFO:teuthology.orchestra.console.smithi064:Power off 2023-12-14T21:32:32.594 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T21:32:32.607 INFO:teuthology.orchestra.console.smithi016:Power off 2023-12-14T21:32:32.607 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T21:32:32.618 INFO:teuthology.orchestra.console.smithi121:Power off 2023-12-14T21:32:32.618 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T21:32:32.625 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-12-14T21:32:32.625 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:32.633 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-12-14T21:32:32.633 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:32.641 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-12-14T21:32:32.641 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:32.648 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-14T21:32:32.654 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-12-14T21:32:32.660 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-12-14T21:32:36.653 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:36.658 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:36.664 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:36.761 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-14T21:32:36.766 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-12-14T21:32:36.772 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-12-14T21:32:40.765 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:40.771 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:40.777 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:40.874 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-14T21:32:40.878 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-14T21:32:40.885 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-12-14T21:32:40.979 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-12-14T21:32:40.986 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-12-14T21:32:41.080 INFO:teuthology.orchestra.console.smithi016:Power on 2023-12-14T21:32:41.080 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T21:32:41.086 INFO:teuthology.orchestra.console.smithi121:Power on 2023-12-14T21:32:41.087 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T21:32:41.100 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2023-12-14T21:32:41.100 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:41.107 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2023-12-14T21:32:41.107 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:41.119 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-14T21:32:41.126 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-12-14T21:32:44.875 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:44.985 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-14T21:32:45.085 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-12-14T21:32:45.120 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:45.126 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:45.186 INFO:teuthology.orchestra.console.smithi064:Power on 2023-12-14T21:32:45.186 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T21:32:45.205 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-12-14T21:32:45.205 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:45.227 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-14T21:32:45.228 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-14T21:32:45.234 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-12-14T21:32:49.229 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:49.236 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:49.244 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:49.339 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-14T21:32:49.345 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-12-14T21:32:49.360 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-12-14T21:32:49.446 INFO:teuthology.orchestra.console.smithi016:Power on completed 2023-12-14T21:32:49.460 INFO:teuthology.orchestra.console.smithi121:Power on completed 2023-12-14T21:32:49.547 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2023-12-14T21:32:49.562 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2023-12-14T21:32:53.343 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T21:32:53.451 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-14T21:32:53.552 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-12-14T21:32:53.652 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-12-14T21:35:35.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:35:35.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:35:54.390 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-14T21:35:54.390 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-12-14T21:36:00.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:00.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:03.473 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-14T21:36:03.474 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-12-14T21:36:09.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:09.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:12.529 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-14T21:36:12.530 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-12-14T21:36:18.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:18.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:21.585 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-12-14T21:36:25.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:27.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:30.641 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-12-14T21:36:36.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:43.538 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-14T21:36:49.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:36:52.625 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-14T21:36:58.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:37:01.681 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-14T21:37:07.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:37:10.737 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-14T21:37:16.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:37:18.537 WARNING:teuthology.provision.fog.smithi016:timed out 2023-12-14T21:37:19.793 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-14T21:37:24.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:37:24.908 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T21:37:24.908 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T21:37:25.182 INFO:teuthology.provision.fog.smithi016:Node is ready 2023-12-14T21:37:25.183 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2023-12-14T21:37:25.203 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2023-12-14T21:37:25.203 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2023-12-14T21:37:25.265 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2023-12-14T21:37:25.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-12-14T21:37:25.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2023-12-14T21:37:25.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2023-12-14T21:37:25.491 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2023-12-14T21:37:25.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-12-14T21:37:25.641 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.6" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-12-14T21:37:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T21:37:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T21:37:25.704 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2023-12-14T21:37:25.705 DEBUG:teuthology.parallel:result is None 2023-12-14T21:37:25.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:37:36.657 WARNING:teuthology.provision.fog.smithi121:timed out 2023-12-14T21:37:42.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:37:42.930 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T21:37:42.930 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T21:37:43.254 INFO:teuthology.provision.fog.smithi121:Node is ready 2023-12-14T21:37:43.254 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2023-12-14T21:37:43.273 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2023-12-14T21:37:43.273 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2023-12-14T21:37:43.332 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2023-12-14T21:37:43.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-12-14T21:37:43.460 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2023-12-14T21:37:43.490 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2023-12-14T21:37:43.557 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2023-12-14T21:37:43.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-12-14T21:37:43.689 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-12-14T21:37:43.743 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.6" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-14T21:37:43.744 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T21:37:43.745 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T21:37:43.745 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T21:37:43.745 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T21:37:43.745 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2023-12-14T21:37:43.745 DEBUG:teuthology.parallel:result is None 2023-12-14T21:38:25.814 WARNING:teuthology.provision.fog.smithi064:timed out 2023-12-14T21:38:31.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:38:32.078 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T21:38:32.079 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T21:38:32.382 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-12-14T21:38:32.382 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-12-14T21:38:32.401 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-12-14T21:38:32.401 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-12-14T21:38:32.460 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-12-14T21:38:32.460 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-12-14T21:38:32.578 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-12-14T21:38:32.608 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-12-14T21:38:32.677 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-12-14T21:38:32.746 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-12-14T21:38:32.814 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel" 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora" 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6" 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T21:38:32.871 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T21:38:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T21:38:32.872 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-12-14T21:38:32.873 DEBUG:teuthology.parallel:result is None 2023-12-14T21:38:33.056 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2023-12-14T21:38:33.057 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T21:38:33.079 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-12-14T21:38:33.079 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T21:38:33.103 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2023-12-14T21:38:33.104 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T21:38:33.122 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2023-12-14T21:38:33.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-12-14T21:38:33.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:38:33.195 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-12-14T21:38:33.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-12-14T21:38:33.295 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-12-14T21:38:33.355 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-12-14T21:38:33.355 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-12-14T21:38:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T21:38:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T21:38:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.6" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T21:38:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T21:38:33.417 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-12-14T21:38:33.437 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-12-14T21:38:33.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-14T21:38:33.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:38:33.506 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-12-14T21:38:33.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-14T21:38:33.576 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-12-14T21:38:33.635 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-12-14T21:38:33.635 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T21:38:33.694 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T21:38:33.695 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-14T21:38:33.695 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T21:38:33.695 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T21:38:33.695 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T21:38:33.695 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T21:38:33.695 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-12-14T21:38:33.720 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2023-12-14T21:38:33.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-12-14T21:38:33.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T21:38:33.788 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-12-14T21:38:33.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-12-14T21:38:33.927 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-12-14T21:38:33.984 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-12-14T21:38:33.985 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.6" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-12-14T21:38:34.042 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T21:38:34.043 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T21:38:34.043 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-12-14T21:38:34.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:38:34.155 INFO:teuthology.dispatcher.supervisor:Running job 7491492 2023-12-14T21:38:34.155 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-12-14_21:31:09-fs-wip-choffman-62793-distro-default-smithi/7491492 --name choffman-2023-12-14_21:31:09-fs-wip-choffman-62793-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/choffman-2023-12-14_21:31:09-fs-wip-choffman-62793-distro-default-smithi/7491492/orig.config.yaml 2023-12-14T21:38:34.158 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-12-14_21:31:09-fs-wip-choffman-62793-distro-default-smithi/7491492 2023-12-14T21:38:34.158 INFO:teuthology.dispatcher.supervisor:Job PID: 1881962 2023-12-14T21:38:34.158 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T21:40:34.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:42:34.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:44:34.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:46:34.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:48:34.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:50:35.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:52:35.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:54:35.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:56:35.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T21:58:35.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:00:35.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:02:36.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:04:36.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:06:36.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:08:36.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:10:36.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:12:37.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:14:37.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:16:37.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:18:37.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:20:37.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:22:37.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:24:38.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:26:38.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:28:38.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:30:38.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:32:38.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:34:38.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:36:39.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:38:39.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:40:39.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:42:39.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:44:39.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:46:39.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:48:40.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:50:40.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:52:40.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:54:40.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:56:40.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T22:58:40.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:00:41.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:02:41.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:04:41.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:06:41.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:08:41.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:10:41.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:12:42.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:14:42.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:16:42.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:18:42.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:20:42.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:22:42.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:24:43.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:26:43.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:28:43.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:30:43.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:32:43.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T23:32:43.854 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T23:32:44.141 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T23:32:44.141 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T23:32:44.191 DEBUG:teuthology.nuke:shortname: smithi016 2023-12-14T23:32:44.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T23:32:44.210 DEBUG:teuthology.nuke:shortname: smithi064 2023-12-14T23:32:44.210 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T23:32:44.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_21:31:09-fs-wip-choffman-62793-distro-default-smithi/7491492', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 21:32:31.039624', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI+TBeu8Dh6GrZLNTCTM3xSZG869WJKF3kz5vFY+NtYFnnObMWzs+z+z2p0YVv4kFzFpeMBA5PikBpG9szBIT3M='} 2023-12-14T23:32:44.223 DEBUG:teuthology.nuke:shortname: smithi121 2023-12-14T23:32:44.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T23:32:44.228 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_21:31:09-fs-wip-choffman-62793-distro-default-smithi/7491492', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 21:32:31.038330', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAomeFzlGyVceywVP1BGxCD47kowURey4RJnwenIukPWNp9D6ZYa1HWDEextCnVyoGnO6iPwrfqgPkrQnH0mOAo='} 2023-12-14T23:32:44.242 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_21:31:09-fs-wip-choffman-62793-distro-default-smithi/7491492', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 21:32:31.040665', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMWe6cN3wihHyBRErtj+HkyY/I4R9l4zGP868H3o/Z/ugr3vdEGr7PzTwOlPD9DBDnWrvb9c1pEMbaDx+T9voc='} 2023-12-14T23:32:44.258 INFO:teuthology.orchestra.console.smithi016:Power off 2023-12-14T23:32:44.258 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T23:32:44.274 INFO:teuthology.orchestra.console.smithi064:Power off 2023-12-14T23:32:44.274 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T23:32:44.288 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-12-14T23:32:44.289 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T23:32:44.299 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-12-14T23:32:44.300 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T23:32:44.315 INFO:teuthology.orchestra.console.smithi121:Power off 2023-12-14T23:32:44.315 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T23:32:44.324 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-14T23:32:44.325 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-14T23:32:44.337 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-12-14T23:32:44.338 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T23:32:44.361 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-12-14T23:32:44.425 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-12-14T23:32:44.425 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-12-14T23:32:44.462 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-12-14T23:32:44.577 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-12-14T23:32:44.585 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2023-12-14T23:32:44.612 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com