2024-01-08T09:00:00.136 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2024-01-08T09:00:00.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:00:00.302 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcfc5450940>, signals=[15]) 2024-01-08T09:00:00.303 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2024-01-08T09:00:00.303 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2024-01-08T09:00:00.303 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-01-08T09:00:00.329 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2024-01-08T09:00:00.329 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2024-01-08T09:00:00.329 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2024-01-08T09:00:00.354 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2024-01-08T09:00:00.354 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2024-01-08T09:00:00.354 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-01-08T09:00:00.448 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-08T09:00:00.467 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-08T09:00:00.491 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-08T09:00:00.495 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of rhel 8.6 2024-01-08T09:00:00.506 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6 2024-01-08T09:00:00.540 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of rhel 8.6 2024-01-08T09:00:00.733 INFO:teuthology.orchestra.console.smithi047:Power off 2024-01-08T09:00:00.733 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T09:00:00.758 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-01-08T09:00:00.758 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:00.776 INFO:teuthology.orchestra.console.smithi124:Power off 2024-01-08T09:00:00.777 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T09:00:00.789 INFO:teuthology.orchestra.console.smithi160:Power off 2024-01-08T09:00:00.789 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T09:00:00.800 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-01-08T09:00:00.801 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2024-01-08T09:00:00.801 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:00.817 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-01-08T09:00:00.818 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:00.830 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2024-01-08T09:00:00.846 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-01-08T09:00:04.804 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:04.832 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:04.848 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:04.914 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-01-08T09:00:04.942 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2024-01-08T09:00:04.957 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-01-08T09:00:08.920 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:08.943 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:08.958 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:09.029 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-08T09:00:09.053 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2024-01-08T09:00:09.067 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-01-08T09:00:09.130 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-01-08T09:00:09.231 INFO:teuthology.orchestra.console.smithi047:Power on 2024-01-08T09:00:09.231 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-08T09:00:09.254 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2024-01-08T09:00:09.255 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:09.279 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-08T09:00:13.056 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:13.067 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:13.168 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2024-01-08T09:00:13.180 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-08T09:00:13.270 INFO:teuthology.orchestra.console.smithi124:Power off completed 2024-01-08T09:00:13.280 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:13.287 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-01-08T09:00:13.371 INFO:teuthology.orchestra.console.smithi124:Power on 2024-01-08T09:00:13.371 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-08T09:00:13.388 INFO:teuthology.orchestra.console.smithi160:Power on 2024-01-08T09:00:13.389 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-08T09:00:13.397 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-08T09:00:13.398 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2024-01-08T09:00:13.398 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:13.418 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2024-01-08T09:00:13.419 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:13.429 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2024-01-08T09:00:13.444 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-08T09:00:17.400 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:17.431 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:17.445 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:17.540 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2024-01-08T09:00:17.556 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-08T09:00:17.628 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-01-08T09:00:17.641 INFO:teuthology.orchestra.console.smithi124:Power on completed 2024-01-08T09:00:17.730 INFO:teuthology.orchestra.console.smithi047:Power on completed 2024-01-08T09:00:17.742 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2024-01-08T09:00:17.832 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2024-01-08T09:00:21.560 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:00:21.670 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-01-08T09:00:21.771 INFO:teuthology.orchestra.console.smithi160:Power on completed 2024-01-08T09:00:21.872 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2024-01-08T09:02:48.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:02:48.966 ERROR:teuthology.orchestra.connection:Error authenticating with smithi047.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-08T09:03:03.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:06.816 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-08T09:03:07.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:10.847 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-08T09:03:12.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:15.868 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-08T09:03:16.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:19.900 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-08T09:03:21.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:24.924 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-08T09:03:25.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:28.956 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-08T09:03:30.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:33.984 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-08T09:03:34.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:38.012 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-08T09:03:39.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:43.040 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-08T09:03:44.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:47.068 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-08T09:03:49.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:52.092 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-08T09:03:52.968 WARNING:teuthology.provision.fog.smithi047:timed out 2024-01-08T09:03:53.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:56.124 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-08T09:03:58.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:03:58.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:04:01.148 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-08T09:04:02.044 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-08T09:04:02.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:04:07.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:04:08.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:04:11.100 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-08T09:04:17.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:04:20.156 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-08T09:04:26.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:04:26.402 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-08T09:04:26.403 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-08T09:04:41.722 INFO:teuthology.provision.fog.smithi047:Node is ready 2024-01-08T09:04:41.722 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2024-01-08T09:04:41.785 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2024-01-08T09:04:41.786 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2024-01-08T09:04:41.847 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2024-01-08T09:04:41.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-01-08T09:04:41.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2024-01-08T09:04:42.006 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2024-01-08T09:04:42.082 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2024-01-08T09:04:42.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-01-08T09:04:42.230 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-01-08T09:04:42.292 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T09:04:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T09:04:42.294 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T09:04:42.294 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2024-01-08T09:04:42.296 DEBUG:teuthology.parallel:result is None 2024-01-08T09:05:02.128 WARNING:teuthology.provision.fog.smithi160:timed out 2024-01-08T09:05:07.155 WARNING:teuthology.provision.fog.smithi124:timed out 2024-01-08T09:05:08.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:05:08.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-08T09:05:08.392 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-08T09:05:08.654 INFO:teuthology.provision.fog.smithi160:Node is ready 2024-01-08T09:05:08.654 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2024-01-08T09:05:08.671 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2024-01-08T09:05:08.672 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2024-01-08T09:05:08.730 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2024-01-08T09:05:08.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2024-01-08T09:05:08.862 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2024-01-08T09:05:08.890 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2024-01-08T09:05:08.958 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2024-01-08T09:05:09.026 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2024-01-08T09:05:09.092 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-01-08T09:05:09.149 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T09:05:09.149 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T09:05:09.149 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T09:05:09.150 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T09:05:09.151 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2024-01-08T09:05:09.151 DEBUG:teuthology.parallel:result is None 2024-01-08T09:05:13.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:05:13.414 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-08T09:05:13.414 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-08T09:05:13.664 INFO:teuthology.provision.fog.smithi124:Node is ready 2024-01-08T09:05:13.665 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2024-01-08T09:05:13.682 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2024-01-08T09:05:13.682 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2024-01-08T09:05:13.740 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2024-01-08T09:05:13.741 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2024-01-08T09:05:13.851 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2024-01-08T09:05:13.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2024-01-08T09:05:13.946 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2024-01-08T09:05:14.013 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2024-01-08T09:05:14.079 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2024-01-08T09:05:14.137 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T09:05:14.137 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T09:05:14.137 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T09:05:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T09:05:14.139 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T09:05:14.139 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2024-01-08T09:05:14.139 DEBUG:teuthology.parallel:result is None 2024-01-08T09:05:14.333 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2024-01-08T09:05:14.333 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-08T09:05:14.358 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2024-01-08T09:05:14.358 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-08T09:05:14.375 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2024-01-08T09:05:14.375 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-08T09:05:14.393 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2024-01-08T09:05:14.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-01-08T09:05:14.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:05:14.467 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-01-08T09:05:14.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-01-08T09:05:14.610 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-01-08T09:05:14.673 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-01-08T09:05:14.674 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-01-08T09:05:14.736 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T09:05:14.736 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T09:05:14.736 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel" 2024-01-08T09:05:14.736 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora" 2024-01-08T09:05:14.736 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6" 2024-01-08T09:05:14.736 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2024-01-08T09:05:14.736 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T09:05:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T09:05:14.738 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-01-08T09:05:14.767 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2024-01-08T09:05:14.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-08T09:05:14.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:05:14.834 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-08T09:05:14.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-08T09:05:14.905 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2024-01-08T09:05:14.961 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2024-01-08T09:05:14.962 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2024-01-08T09:05:15.018 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T09:05:15.018 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T09:05:15.019 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T09:05:15.020 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T09:05:15.020 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2024-01-08T09:05:15.042 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2024-01-08T09:05:15.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-08T09:05:15.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T09:05:15.112 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-01-08T09:05:15.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-08T09:05:15.183 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-01-08T09:05:15.243 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-01-08T09:05:15.243 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-01-08T09:05:15.301 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T09:05:15.301 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T09:05:15.302 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T09:05:15.303 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T09:05:15.303 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-01-08T09:05:15.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:05:15.420 INFO:teuthology.dispatcher.supervisor:Running job 7509045 2024-01-08T09:05:15.420 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509045 --name vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509045/orig.config.yaml 2024-01-08T09:05:15.424 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509045 2024-01-08T09:05:15.424 INFO:teuthology.dispatcher.supervisor:Job PID: 1788031 2024-01-08T09:05:15.425 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-08T09:07:15.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:09:15.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:11:15.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:13:15.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:15:15.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:17:15.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:19:15.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:21:15.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:23:16.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:25:16.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:27:16.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T09:27:16.604 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-08T09:27:16.750 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-08T09:27:16.750 INFO:teuthology.nuke:Checking targets against current locks 2024-01-08T09:27:16.798 DEBUG:teuthology.nuke:shortname: smithi047 2024-01-08T09:27:16.798 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-08T09:27:16.824 DEBUG:teuthology.nuke:shortname: smithi124 2024-01-08T09:27:16.824 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-08T09:27:16.828 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509045', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 08:59:59.247237', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHMr2H67TUpQR6XtFvoHiMA9Id/jvGCcW4847xo1FKG1GfhT8MwO6VQTSUBpgLyDMqgjiRsp5PNg7ip1td3ZRg='} 2024-01-08T09:27:16.853 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509045', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 08:59:59.244593', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO/uevaZweF3txn8gicBRx2OBd7j5cSikakKrrVnlOfKkRfI9cnUhovITWsnzgskdHAB3+El7ihjnEkhPNGO4U4='} 2024-01-08T09:27:16.857 DEBUG:teuthology.nuke:shortname: smithi160 2024-01-08T09:27:16.857 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-08T09:27:16.879 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509045', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 08:59:59.246034', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN239fgEnBbRR52nBzKA1v5UoD4Q2Dpa29QxGsqmc5/m7DkvTQkrg/nRGnNHi/1wnN1GwXyzM8itk7E7MghuosM='} 2024-01-08T09:27:16.888 INFO:teuthology.orchestra.console.smithi047:Power off 2024-01-08T09:27:16.888 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T09:27:16.904 INFO:teuthology.orchestra.console.smithi124:Power off 2024-01-08T09:27:16.905 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T09:27:16.917 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-01-08T09:27:16.917 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:27:16.925 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2024-01-08T09:27:16.925 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:27:16.937 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-08T09:27:16.945 INFO:teuthology.orchestra.console.smithi160:Power off 2024-01-08T09:27:16.946 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T09:27:16.954 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2024-01-08T09:27:16.965 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-01-08T09:27:16.965 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T09:27:16.987 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-08T09:27:17.039 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-01-08T09:27:17.055 INFO:teuthology.orchestra.console.smithi124:Power off completed 2024-01-08T09:27:17.087 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-01-08T09:27:17.195 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com 2024-01-08T09:27:17.202 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2024-01-08T09:27:17.235 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com