2024-04-17T14:39:46.232 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T14:39:46.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:39:46.405 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4c0bbbfc10>, signals=[15]) 2024-04-17T14:39:46.406 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2024-04-17T14:39:46.407 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:46.407 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-04-17T14:39:46.424 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2024-04-17T14:39:46.424 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:46.424 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-17T14:39:46.440 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-04-17T14:39:46.440 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:46.440 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-17T14:39:46.537 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:46.550 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:46.574 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream 2024-04-17T14:39:46.579 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:46.589 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 9.stream 2024-04-17T14:39:46.618 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2024-04-17T14:39:46.893 INFO:teuthology.orchestra.console.smithi070:Power off 2024-04-17T14:39:46.893 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:46.906 INFO:teuthology.orchestra.console.smithi033:Power off 2024-04-17T14:39:46.907 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:46.915 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:46.915 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.930 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:46.930 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.938 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-17T14:39:46.953 INFO:teuthology.orchestra.console.smithi119:Power off 2024-04-17T14:39:46.953 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:46.961 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-04-17T14:39:46.975 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:46.975 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.996 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-17T14:39:47.040 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-04-17T14:39:47.063 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-04-17T14:39:47.097 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-04-17T14:39:47.141 INFO:teuthology.orchestra.console.smithi070:Power on 2024-04-17T14:39:47.141 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:47.164 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:47.164 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:47.172 INFO:teuthology.orchestra.console.smithi033:Power on 2024-04-17T14:39:47.172 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:47.186 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-17T14:39:47.192 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:47.192 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:47.199 INFO:teuthology.orchestra.console.smithi119:Power on 2024-04-17T14:39:47.199 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:47.212 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-04-17T14:39:47.219 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:47.219 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:47.239 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-17T14:39:51.190 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:51.213 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:51.240 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:51.299 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-04-17T14:39:51.322 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-04-17T14:39:51.349 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-04-17T14:39:51.400 INFO:teuthology.orchestra.console.smithi070:Power on completed 2024-04-17T14:39:51.423 INFO:teuthology.orchestra.console.smithi033:Power on completed 2024-04-17T14:39:51.450 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-04-17T14:39:51.502 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2024-04-17T14:39:51.524 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2024-04-17T14:39:51.551 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-04-17T14:42:09.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:42:09.610 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-17T14:43:13.613 WARNING:teuthology.provision.fog.smithi033:timed out 2024-04-17T14:43:19.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:42.250 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:43:42.250 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:43:57.461 INFO:teuthology.provision.fog.smithi033:Node is ready 2024-04-17T14:43:57.461 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2024-04-17T14:43:57.480 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2024-04-17T14:43:57.480 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2024-04-17T14:43:57.537 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2024-04-17T14:43:57.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-04-17T14:43:57.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2024-04-17T14:43:57.701 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2024-04-17T14:43:57.774 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2024-04-17T14:43:57.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-04-17T14:43:57.917 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-04-17T14:43:57.972 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-04-17T14:43:57.972 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:43:57.973 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:43:57.974 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2024-04-17T14:43:57.975 DEBUG:teuthology.parallel:result is None 2024-04-17T14:45:12.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:15.454 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:45:21.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:24.510 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:45:30.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:33.566 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:45:39.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:42.626 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:45:48.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:51.678 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:45:57.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:57.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:00.734 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:46:00.734 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:46:06.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:06.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:09.790 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:46:15.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:16.862 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:46:18.846 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:46:22.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:24.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:25.918 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:46:27.906 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:46:31.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:33.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:34.974 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T14:46:36.958 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:46:40.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:42.293 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:46:42.294 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:46:42.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:46.014 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:46:52.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:02.641 INFO:teuthology.provision.fog.smithi070:Node is ready 2024-04-17T14:47:02.642 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2024-04-17T14:47:02.659 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2024-04-17T14:47:02.659 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2024-04-17T14:47:02.720 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2024-04-17T14:47:02.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-04-17T14:47:02.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2024-04-17T14:47:02.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2024-04-17T14:47:02.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2024-04-17T14:47:03.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-04-17T14:47:03.081 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-17T14:47:03.135 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-17T14:47:03.135 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:47:03.136 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:47:03.137 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2024-04-17T14:47:03.137 DEBUG:teuthology.parallel:result is None 2024-04-17T14:47:10.366 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:47:16.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:19.422 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:47:25.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:28.478 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T14:47:34.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:34.689 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:47:34.689 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:47:55.010 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-04-17T14:47:55.010 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-04-17T14:47:55.028 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2024-04-17T14:47:55.029 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2024-04-17T14:47:55.086 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2024-04-17T14:47:55.086 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-04-17T14:47:55.228 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2024-04-17T14:47:55.259 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2024-04-17T14:47:55.328 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2024-04-17T14:47:55.397 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-04-17T14:47:55.465 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-17T14:47:55.519 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-04-17T14:47:55.519 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:47:55.520 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:47:55.521 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-04-17T14:47:55.521 DEBUG:teuthology.parallel:result is None 2024-04-17T14:47:55.774 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2024-04-17T14:47:55.774 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:47:55.811 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2024-04-17T14:47:55.811 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:47:55.838 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2024-04-17T14:47:55.838 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:47:55.862 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:47:55.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-04-17T14:47:55.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:55.962 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-04-17T14:47:56.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-04-17T14:47:56.144 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-04-17T14:47:56.199 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-04-17T14:47:56.199 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-04-17T14:47:56.254 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:47:56.255 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:47:56.256 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:47:56.256 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:47:56.256 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:47:56.256 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-04-17T14:47:56.286 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:47:56.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-17T14:47:56.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:56.375 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-04-17T14:47:56.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-17T14:47:56.544 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-04-17T14:47:56.598 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-04-17T14:47:56.598 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-17T14:47:56.652 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:47:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:47:56.654 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-17T14:47:56.677 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:47:56.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-17T14:47:56.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:56.762 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-04-17T14:47:56.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-17T14:47:56.831 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-04-17T14:47:56.887 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-04-17T14:47:56.887 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-17T14:47:56.943 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:47:56.944 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:47:56.945 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-17T14:47:56.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:47:57.068 INFO:teuthology.dispatcher.supervisor:Running job 7660347 2024-04-17T14:47:57.068 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660347 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660347/orig.config.yaml 2024-04-17T14:47:57.072 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660347 2024-04-17T14:47:57.072 INFO:teuthology.dispatcher.supervisor:Job PID: 1516645 2024-04-17T14:47:57.072 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T14:49:57.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:51:57.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:53:57.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:55:57.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:57:57.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:57:57.453 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1