2023-12-17T11:21:30.492 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-17T11:21:30.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:21:30.664 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac4453e940>, signals=[15]) 2023-12-17T11:21:30.665 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-12-17T11:21:30.665 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-12-17T11:21:30.665 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-12-17T11:21:30.693 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-12-17T11:21:30.693 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-12-17T11:21:30.693 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-12-17T11:21:30.717 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-12-17T11:21:30.718 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-12-17T11:21:30.718 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-17T11:21:30.798 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-17T11:21:30.821 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-17T11:21:30.847 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-17T11:21:30.859 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.6 2023-12-17T11:21:30.872 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of rhel 8.6 2023-12-17T11:21:30.900 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.6 2023-12-17T11:21:31.401 INFO:teuthology.orchestra.console.smithi118:Power off 2023-12-17T11:21:31.401 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T11:21:31.413 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-17T11:21:31.414 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T11:21:31.424 INFO:teuthology.orchestra.console.smithi006:Power off 2023-12-17T11:21:31.425 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T11:21:31.433 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-12-17T11:21:31.434 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:31.442 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-17T11:21:31.443 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:31.453 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-12-17T11:21:31.454 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:31.462 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-12-17T11:21:31.468 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-17T11:21:31.477 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-12-17T11:21:35.467 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:35.473 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:35.479 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:35.576 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-12-17T11:21:35.581 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-17T11:21:35.587 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-12-17T11:21:39.581 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:39.587 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:39.593 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:39.689 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-12-17T11:21:39.695 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-17T11:21:39.701 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-12-17T11:21:39.790 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-12-17T11:21:39.795 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-17T11:21:39.891 INFO:teuthology.orchestra.console.smithi118:Power on 2023-12-17T11:21:39.891 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-17T11:21:39.898 INFO:teuthology.orchestra.console.smithi174:Power on 2023-12-17T11:21:39.899 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-17T11:21:39.911 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2023-12-17T11:21:39.912 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:39.918 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-12-17T11:21:39.918 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:39.932 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-12-17T11:21:39.938 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-17T11:21:43.706 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:43.813 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-12-17T11:21:43.914 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-12-17T11:21:43.932 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:43.939 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:44.015 INFO:teuthology.orchestra.console.smithi006:Power on 2023-12-17T11:21:44.015 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-17T11:21:44.036 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2023-12-17T11:21:44.036 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:44.044 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-12-17T11:21:44.047 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-17T11:21:44.056 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-12-17T11:21:44.145 INFO:teuthology.orchestra.console.smithi118:Power on completed 2023-12-17T11:21:44.246 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-12-17T11:21:48.051 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:48.057 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:48.165 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-12-17T11:21:48.234 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-17T11:21:48.335 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-12-17T11:21:48.435 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-12-17T11:21:52.169 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:21:52.278 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-12-17T11:21:52.378 INFO:teuthology.orchestra.console.smithi006:Power on completed 2023-12-17T11:21:52.479 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-12-17T11:26:22.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:26.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:29.649 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-12-17T11:26:35.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:38.706 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-12-17T11:26:41.170 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-17T11:26:44.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:47.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:47.761 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-12-17T11:26:50.225 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-17T11:26:53.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:56.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:56.817 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-12-17T11:26:59.281 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-17T11:27:02.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:03.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:05.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:05.878 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-12-17T11:27:06.865 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:27:08.337 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-17T11:27:11.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:12.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:14.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:14.930 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-12-17T11:27:15.921 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:27:17.397 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-17T11:27:20.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:21.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:23.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:24.977 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:27:30.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:34.034 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:27:40.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:43.089 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:27:49.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:27:52.145 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:27:58.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:01.202 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:28:07.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:10.289 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:28:16.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:19.345 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-17T11:28:20.939 WARNING:teuthology.provision.fog.smithi006:timed out 2023-12-17T11:28:23.401 WARNING:teuthology.provision.fog.smithi174:timed out 2023-12-17T11:28:25.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:26.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:27.276 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-17T11:28:27.276 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-17T11:28:27.563 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-12-17T11:28:27.563 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-12-17T11:28:27.583 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-12-17T11:28:27.583 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-12-17T11:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-12-17T11:28:27.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-12-17T11:28:27.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-12-17T11:28:27.796 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-12-17T11:28:27.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-12-17T11:28:27.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-12-17T11:28:28.020 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-12-17T11:28:28.081 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:28:28.081 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:28:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:28:28.083 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:28:28.083 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:28:28.083 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-12-17T11:28:28.084 DEBUG:teuthology.parallel:result is None 2023-12-17T11:28:29.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:29.677 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-17T11:28:29.677 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-17T11:28:29.933 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-12-17T11:28:29.933 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-12-17T11:28:29.950 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174 2023-12-17T11:28:29.951 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174 /etc/hosts 2023-12-17T11:28:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-12-17T11:28:30.011 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-17T11:28:30.126 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174/smithi174/g' /etc/hosts 2023-12-17T11:28:30.154 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-12-17T11:28:30.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174/smithi174/g' /etc/hostname 2023-12-17T11:28:30.294 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-17T11:28:30.364 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:28:30.424 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:28:30.425 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:28:30.425 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-12-17T11:28:30.426 DEBUG:teuthology.parallel:result is None 2023-12-17T11:29:25.406 WARNING:teuthology.provision.fog.smithi118:timed out 2023-12-17T11:29:31.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:29:31.674 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-17T11:29:31.674 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-17T11:29:31.966 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-12-17T11:29:31.966 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-12-17T11:29:31.986 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118 2023-12-17T11:29:31.986 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118 /etc/hosts 2023-12-17T11:29:32.046 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-12-17T11:29:32.046 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-12-17T11:29:32.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118/smithi118/g' /etc/hosts 2023-12-17T11:29:32.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-12-17T11:29:32.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118/smithi118/g' /etc/hostname 2023-12-17T11:29:32.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-12-17T11:29:32.429 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-12-17T11:29:32.487 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:29:32.487 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:29:32.487 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-12-17T11:29:32.487 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:29:32.488 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:29:32.488 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-12-17T11:29:32.489 DEBUG:teuthology.parallel:result is None 2023-12-17T11:29:32.677 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-12-17T11:29:32.678 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-17T11:29:32.703 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-12-17T11:29:32.704 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-17T11:29:32.720 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-12-17T11:29:32.720 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-17T11:29:32.738 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-12-17T11:29:32.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-12-17T11:29:32.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:29:32.807 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-12-17T11:29:32.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-12-17T11:29:32.907 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-12-17T11:29:32.967 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-12-17T11:29:32.967 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-12-17T11:29:33.028 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:29:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:29:33.030 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:29:33.030 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-17T11:29:33.030 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:29:33.030 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:29:33.030 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:29:33.030 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:29:33.030 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-12-17T11:29:33.054 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-12-17T11:29:33.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-12-17T11:29:33.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:29:33.123 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-12-17T11:29:33.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-12-17T11:29:33.198 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-12-17T11:29:33.258 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-12-17T11:29:33.258 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-12-17T11:29:33.318 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:29:33.318 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:29:33.318 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:29:33.319 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:29:33.320 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-12-17T11:29:33.345 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-12-17T11:29:33.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-17T11:29:33.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:29:33.413 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-12-17T11:29:33.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-17T11:29:33.551 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-12-17T11:29:33.608 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-12-17T11:29:33.609 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:29:33.667 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:29:33.668 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:29:33.668 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:29:33.668 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-17T11:29:33.668 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:29:33.668 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:29:33.668 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:29:33.668 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:29:33.669 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-17T11:29:33.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:29:33.913 INFO:teuthology.dispatcher.supervisor:Running job 7495181 2023-12-17T11:29:33.913 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495181 --name rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iozone}} -- /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495181/orig.config.yaml 2023-12-17T11:29:33.916 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495181 2023-12-17T11:29:33.916 INFO:teuthology.dispatcher.supervisor:Job PID: 3990504 2023-12-17T11:29:33.916 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-17T11:31:34.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:33:34.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:35:34.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:37:34.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:39:34.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:41:34.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:43:35.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:45:35.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:47:35.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:49:35.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:51:35.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:53:35.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:55:36.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:57:36.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:59:36.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:01:36.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:03:36.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:05:36.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:07:37.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:09:37.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:11:37.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:11:37.452 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-17T12:11:37.587 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-17T12:11:37.587 INFO:teuthology.nuke:Checking targets against current locks 2023-12-17T12:11:37.629 DEBUG:teuthology.nuke:shortname: smithi006 2023-12-17T12:11:37.629 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:11:37.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:29.680910', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCEFEDsqqiBJTK13MeVAqG8RjcqJqiZMTFOAL8ekV81LCuCj/DDa+hggJMTKW0qRScOFTTFTXfWI5ZzjPQAqGc='} 2023-12-17T12:11:37.656 DEBUG:teuthology.nuke:shortname: smithi118 2023-12-17T12:11:37.657 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:11:37.673 DEBUG:teuthology.nuke:shortname: smithi174 2023-12-17T12:11:37.673 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:11:37.676 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:29.679293', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLG91XfaZONb3+UgN7O3BYwRGjISQLNBGOhX86AGsqNtxFE0Cbsv0uwyj+fL1Ny8vTaFtPgfbgfoQg+ymUFToAw='} 2023-12-17T12:11:37.686 INFO:teuthology.orchestra.console.smithi006:Power off 2023-12-17T12:11:37.686 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:11:37.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:29.677490', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPPCkRjHF1pW8eN6MR4qtxfNHospk1sIiXMexB245BvT2P9pCczgV4vMUQRKIX5hxh/K1m6yNKlltM/iLf/YuLI='} 2023-12-17T12:11:37.709 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-12-17T12:11:37.709 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:11:37.731 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-12-17T12:11:37.744 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-17T12:11:37.744 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:11:37.756 INFO:teuthology.orchestra.console.smithi118:Power off 2023-12-17T12:11:37.757 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:11:37.765 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-17T12:11:37.765 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:11:37.779 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-12-17T12:11:37.779 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:11:37.787 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-17T12:11:37.800 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-12-17T12:11:37.832 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-12-17T12:11:37.888 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-17T12:11:37.900 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-12-17T12:11:37.985 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2023-12-17T12:11:38.043 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com 2023-12-17T12:11:38.043 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com