2024-01-08T07:40:06.643 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2024-01-08T07:40:06.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:40:06.842 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1fba174940>, signals=[15]) 2024-01-08T07:40:06.842 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2024-01-08T07:40:06.842 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2024-01-08T07:40:06.843 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-01-08T07:40:06.866 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2024-01-08T07:40:06.866 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2024-01-08T07:40:06.866 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-01-08T07:40:06.891 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2024-01-08T07:40:06.891 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2024-01-08T07:40:06.891 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-01-08T07:40:06.997 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-08T07:40:07.020 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-08T07:40:07.044 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of rhel 8.6 2024-01-08T07:40:07.070 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-08T07:40:07.075 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6 2024-01-08T07:40:07.133 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.6 2024-01-08T07:40:07.301 INFO:teuthology.orchestra.console.smithi080:Power off 2024-01-08T07:40:07.301 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T07:40:07.317 INFO:teuthology.orchestra.console.smithi107:Power off 2024-01-08T07:40:07.317 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T07:40:07.327 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-01-08T07:40:07.328 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:07.344 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-01-08T07:40:07.344 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:07.355 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-08T07:40:07.372 INFO:teuthology.orchestra.console.smithi110:Power off 2024-01-08T07:40:07.372 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T07:40:07.381 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-01-08T07:40:07.398 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-01-08T07:40:07.398 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:07.432 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-08T07:40:11.360 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:11.382 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:11.432 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:11.469 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-08T07:40:11.492 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-01-08T07:40:11.542 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-08T07:40:15.473 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:15.493 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:15.543 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:15.583 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-08T07:40:15.602 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-01-08T07:40:15.655 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-08T07:40:15.685 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-01-08T07:40:15.756 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-01-08T07:40:15.786 INFO:teuthology.orchestra.console.smithi080:Power on 2024-01-08T07:40:15.786 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-08T07:40:15.809 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2024-01-08T07:40:15.809 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:15.835 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-08T07:40:15.859 INFO:teuthology.orchestra.console.smithi110:Power on 2024-01-08T07:40:15.859 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-08T07:40:15.882 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2024-01-08T07:40:15.882 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:15.907 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-08T07:40:19.605 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:19.714 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-01-08T07:40:19.815 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-01-08T07:40:19.836 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:19.908 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:19.919 INFO:teuthology.orchestra.console.smithi107:Power on 2024-01-08T07:40:19.920 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-08T07:40:19.944 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2024-01-08T07:40:19.944 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:19.954 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-08T07:40:19.967 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-01-08T07:40:20.021 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-08T07:40:23.956 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:23.968 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:24.022 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:24.065 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-08T07:40:24.080 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-01-08T07:40:24.132 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-08T07:40:24.166 INFO:teuthology.orchestra.console.smithi080:Power on completed 2024-01-08T07:40:24.233 INFO:teuthology.orchestra.console.smithi110:Power on completed 2024-01-08T07:40:24.267 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2024-01-08T07:40:24.334 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2024-01-08T07:40:28.084 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T07:40:28.193 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-01-08T07:40:28.294 INFO:teuthology.orchestra.console.smithi107:Power on completed 2024-01-08T07:40:28.395 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2024-01-08T07:43:10.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:10.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:13.212 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:43:13.212 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-08T07:43:14.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:17.244 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-08T07:43:19.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:19.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:22.268 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:43:22.269 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-08T07:43:23.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:26.304 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-08T07:43:28.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:28.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:31.328 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:43:31.329 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-08T07:43:32.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:35.388 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-08T07:43:37.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:37.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:40.412 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:43:40.412 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-08T07:43:41.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:44.444 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-08T07:43:46.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:46.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:49.468 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:43:49.468 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-08T07:43:50.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:53.504 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-08T07:43:55.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:55.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:43:58.524 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-08T07:43:58.528 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:43:59.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:44:02.588 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-08T07:44:04.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:44:04.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:44:08.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:44:22.844 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:44:28.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:44:31.900 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:44:37.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:44:40.956 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-08T07:44:46.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:44:47.756 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-08T07:44:47.756 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-08T07:45:03.272 INFO:teuthology.provision.fog.smithi110:Node is ready 2024-01-08T07:45:03.273 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2024-01-08T07:45:03.294 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2024-01-08T07:45:03.295 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2024-01-08T07:45:03.355 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2024-01-08T07:45:03.356 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-01-08T07:45:03.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2024-01-08T07:45:03.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2024-01-08T07:45:03.590 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2024-01-08T07:45:03.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-01-08T07:45:03.728 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-01-08T07:45:03.785 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T07:45:03.786 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-08T07:45:03.787 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T07:45:03.787 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T07:45:03.787 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T07:45:03.787 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T07:45:03.787 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2024-01-08T07:45:03.789 DEBUG:teuthology.parallel:result is None 2024-01-08T07:45:04.529 WARNING:teuthology.provision.fog.smithi080:timed out 2024-01-08T07:45:08.596 WARNING:teuthology.provision.fog.smithi107:timed out 2024-01-08T07:45:10.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:45:10.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-08T07:45:10.755 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-08T07:45:11.034 INFO:teuthology.provision.fog.smithi080:Node is ready 2024-01-08T07:45:11.034 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2024-01-08T07:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2024-01-08T07:45:11.054 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2024-01-08T07:45:11.113 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2024-01-08T07:45:11.114 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-01-08T07:45:11.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2024-01-08T07:45:11.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2024-01-08T07:45:11.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2024-01-08T07:45:11.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-01-08T07:45:11.495 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-01-08T07:45:11.555 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-08T07:45:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T07:45:11.557 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T07:45:11.557 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T07:45:11.557 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T07:45:11.557 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2024-01-08T07:45:11.557 DEBUG:teuthology.parallel:result is None 2024-01-08T07:45:14.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:45:14.852 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-08T07:45:14.852 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-08T07:45:15.092 INFO:teuthology.provision.fog.smithi107:Node is ready 2024-01-08T07:45:15.092 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2024-01-08T07:45:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2024-01-08T07:45:15.150 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2024-01-08T07:45:15.208 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2024-01-08T07:45:15.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-01-08T07:45:15.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2024-01-08T07:45:15.359 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2024-01-08T07:45:15.426 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2024-01-08T07:45:15.494 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-01-08T07:45:15.560 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-01-08T07:45:15.617 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T07:45:15.617 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T07:45:15.617 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2024-01-08T07:45:15.617 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2024-01-08T07:45:15.617 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2024-01-08T07:45:15.617 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T07:45:15.618 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T07:45:15.618 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2024-01-08T07:45:15.619 DEBUG:teuthology.parallel:result is None 2024-01-08T07:45:15.826 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2024-01-08T07:45:15.827 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-08T07:45:15.855 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2024-01-08T07:45:15.855 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-08T07:45:15.879 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2024-01-08T07:45:15.880 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-08T07:45:15.897 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2024-01-08T07:45:15.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-08T07:45:15.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:45:15.966 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-01-08T07:45:16.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-08T07:45:16.037 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-01-08T07:45:16.097 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-01-08T07:45:16.097 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-01-08T07:45:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T07:45:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T07:45:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2024-01-08T07:45:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2024-01-08T07:45:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2024-01-08T07:45:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-01-08T07:45:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T07:45:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T07:45:16.159 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-01-08T07:45:16.188 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2024-01-08T07:45:16.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-01-08T07:45:16.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:45:16.255 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-01-08T07:45:16.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-01-08T07:45:16.322 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-01-08T07:45:16.379 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-01-08T07:45:16.379 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-01-08T07:45:16.436 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T07:45:16.436 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T07:45:16.436 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2024-01-08T07:45:16.436 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2024-01-08T07:45:16.436 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T07:45:16.437 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T07:45:16.438 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-01-08T07:45:16.471 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2024-01-08T07:45:16.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-08T07:45:16.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-08T07:45:16.542 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-01-08T07:45:16.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-08T07:45:16.674 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-01-08T07:45:16.732 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-01-08T07:45:16.733 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2024-01-08T07:45:16.790 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-08T07:45:16.791 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-08T07:45:16.791 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-08T07:45:16.791 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-08T07:45:16.791 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-08T07:45:16.791 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-08T07:45:16.791 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-08T07:45:16.791 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-01-08T07:45:16.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:45:16.913 INFO:teuthology.dispatcher.supervisor:Running job 7508939 2024-01-08T07:45:16.913 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508939 --name vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508939/orig.config.yaml 2024-01-08T07:45:16.917 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508939 2024-01-08T07:45:16.917 INFO:teuthology.dispatcher.supervisor:Job PID: 418750 2024-01-08T07:45:16.917 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-08T07:47:17.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:49:17.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:51:17.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:53:17.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:55:17.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:57:17.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T07:59:18.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T08:01:18.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T08:03:18.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T08:05:18.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T08:07:18.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-08T08:07:18.800 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-08T08:07:19.056 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-08T08:07:19.057 INFO:teuthology.nuke:Checking targets against current locks 2024-01-08T08:07:19.116 DEBUG:teuthology.nuke:shortname: smithi080 2024-01-08T08:07:19.117 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-08T08:07:19.139 DEBUG:teuthology.nuke:shortname: smithi107 2024-01-08T08:07:19.139 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-08T08:07:19.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508939', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 07:40:05.745614', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsJ+VeMVEerLiDg+LUgYa6rDV9fuxpWqebd+t8OyyLuR5T4rwJIgSubouubt9IRCVzesJ3PVfZiNOjkEVkkz50='} 2024-01-08T08:07:19.156 DEBUG:teuthology.nuke:shortname: smithi110 2024-01-08T08:07:19.156 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-08T08:07:19.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508939', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 07:40:05.744537', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFAVRHdgZQkKN2WGW5B+PfR1GEatl9tb/2BLXDCPU+LfVjo9pq3Q4PISTvhj5WjeUi3C/Ya+Ymldu19ZfpYHBds='} 2024-01-08T08:07:19.177 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508939', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 07:40:05.743224', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOoS4cF7QiGN8tn4ek5XDJwSf4a9jktFADIW9b9dptSdNjHlOhK8xzDiTgClDsn/4IGLts74GAIGv+WNsrrUzeU='} 2024-01-08T08:07:19.190 INFO:teuthology.orchestra.console.smithi080:Power off 2024-01-08T08:07:19.191 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T08:07:19.215 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-01-08T08:07:19.216 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T08:07:19.234 INFO:teuthology.orchestra.console.smithi110:Power off 2024-01-08T08:07:19.234 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T08:07:19.246 INFO:teuthology.orchestra.console.smithi107:Power off 2024-01-08T08:07:19.246 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-08T08:07:19.256 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-08T08:07:19.258 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-01-08T08:07:19.259 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T08:07:19.270 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-01-08T08:07:19.270 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-08T08:07:19.283 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-08T08:07:19.297 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-01-08T08:07:19.357 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-01-08T08:07:19.384 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-01-08T08:07:19.398 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-01-08T08:07:19.515 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com 2024-01-08T08:07:19.533 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2024-01-08T08:07:19.539 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com