2024-04-17T14:10:00.235 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T14:10:00.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:10:00.474 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb9b295bc10>, signals=[15]) 2024-04-17T14:10:00.474 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-04-17T14:10:00.475 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:10:00.475 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-17T14:10:00.492 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-04-17T14:10:00.492 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:10:00.492 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-17T14:10:00.516 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-04-17T14:10:00.517 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:10:00.517 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-17T14:10:00.616 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:10:00.651 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:10:00.658 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:10:00.666 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2024-04-17T14:10:00.701 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2024-04-17T14:10:00.722 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream 2024-04-17T14:10:01.582 INFO:teuthology.orchestra.console.smithi179:Power off 2024-04-17T14:10:01.583 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:10:01.596 INFO:teuthology.orchestra.console.smithi112:Power off 2024-04-17T14:10:01.596 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:10:01.604 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-04-17T14:10:01.604 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:01.619 INFO:teuthology.orchestra.console.smithi161:Power off 2024-04-17T14:10:01.620 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:10:01.629 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-17T14:10:01.629 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-04-17T14:10:01.630 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:01.644 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-04-17T14:10:01.645 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:01.654 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-17T14:10:01.686 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-17T14:10:01.730 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-04-17T14:10:01.755 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-04-17T14:10:01.787 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-04-17T14:10:01.831 INFO:teuthology.orchestra.console.smithi179:Power on 2024-04-17T14:10:01.832 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:10:01.855 INFO:teuthology.orchestra.console.smithi112:Power on 2024-04-17T14:10:01.855 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:10:01.863 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-04-17T14:10:01.864 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:01.878 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-04-17T14:10:01.879 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:01.887 INFO:teuthology.orchestra.console.smithi161:Power on 2024-04-17T14:10:01.888 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:10:01.895 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-17T14:10:01.899 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-17T14:10:01.909 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-04-17T14:10:01.910 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:01.930 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-17T14:10:05.901 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:05.909 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:05.931 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:06.011 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-17T14:10:06.017 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-17T14:10:06.038 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-04-17T14:10:06.112 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-04-17T14:10:06.139 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-04-17T14:10:06.213 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-04-17T14:10:06.239 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-04-17T14:10:10.022 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:10:10.132 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-17T14:10:10.233 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-04-17T14:10:10.333 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-04-17T14:13:03.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:06.558 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:13:12.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:15.614 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:13:21.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:24.670 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:13:30.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:33.726 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:13:39.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:42.782 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:13:48.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:51.838 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:13:57.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:16.350 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:14:22.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:25.406 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:14:31.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:34.494 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-17T14:14:40.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:40.753 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:14:40.753 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:15:01.147 INFO:teuthology.provision.fog.smithi179:Node is ready 2024-04-17T14:15:01.148 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2024-04-17T14:15:01.205 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2024-04-17T14:15:01.206 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2024-04-17T14:15:01.262 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2024-04-17T14:15:01.263 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-17T14:15:01.385 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2024-04-17T14:15:01.415 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2024-04-17T14:15:01.484 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2024-04-17T14:15:01.552 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-17T14:15:01.619 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-17T14:15:01.673 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-17T14:15:01.673 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:15:01.674 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:15:01.675 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2024-04-17T14:15:01.676 DEBUG:teuthology.parallel:result is None 2024-04-17T14:15:53.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:15:56.510 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-17T14:16:02.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:05.598 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-17T14:16:11.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:14.654 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-17T14:16:20.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:23.710 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-17T14:16:29.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:32.766 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-17T14:16:38.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:41.854 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-17T14:16:47.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:10.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:13.438 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:17:19.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:22.494 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:17:28.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:31.555 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:17:37.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:40.638 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:17:46.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:47.864 WARNING:teuthology.provision.fog.smithi161:timed out 2024-04-17T14:17:49.694 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:17:53.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:54.193 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:17:54.194 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:17:54.516 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-04-17T14:17:54.517 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-04-17T14:17:54.531 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-04-17T14:17:54.531 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-04-17T14:17:54.586 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-04-17T14:17:54.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-17T14:17:54.680 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-04-17T14:17:54.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-04-17T14:17:54.774 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-04-17T14:17:54.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-17T14:17:54.908 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-17T14:17:54.962 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-04-17T14:17:54.962 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-04-17T14:17:54.962 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-04-17T14:17:54.962 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:17:54.962 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:17:54.963 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:17:54.963 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-04-17T14:17:54.964 DEBUG:teuthology.parallel:result is None 2024-04-17T14:17:55.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:58.750 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:18:04.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:18:23.134 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:18:29.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:18:32.190 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:18:38.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:18:41.246 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-17T14:18:47.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:18:47.541 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:18:47.542 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:19:07.854 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-04-17T14:19:07.855 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-04-17T14:19:07.873 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2024-04-17T14:19:07.873 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2024-04-17T14:19:07.931 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-04-17T14:19:07.931 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-04-17T14:19:08.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2024-04-17T14:19:08.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-04-17T14:19:08.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2024-04-17T14:19:08.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-04-17T14:19:08.277 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:19:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:19:08.334 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:19:08.334 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:19:08.334 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-04-17T14:19:08.335 DEBUG:teuthology.parallel:result is None 2024-04-17T14:19:08.542 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-04-17T14:19:08.543 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:19:08.567 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-04-17T14:19:08.567 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:19:08.583 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2024-04-17T14:19:08.583 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:19:08.601 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:19:08.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-17T14:19:08.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:19:08.688 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-17T14:19:08.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-17T14:19:08.760 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-17T14:19:08.814 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-17T14:19:08.815 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-17T14:19:08.868 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:19:08.869 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:19:08.870 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-17T14:19:08.892 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:19:08.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-17T14:19:08.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:19:08.979 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-04-17T14:19:09.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-17T14:19:09.148 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-04-17T14:19:09.203 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-04-17T14:19:09.203 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:19:09.258 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:19:09.259 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:19:09.259 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:19:09.259 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:19:09.259 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-17T14:19:09.283 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:19:09.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-17T14:19:09.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:19:09.371 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-17T14:19:09.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-17T14:19:09.541 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-04-17T14:19:09.595 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-04-17T14:19:09.595 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-17T14:19:09.649 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-17T14:19:09.649 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:19:09.650 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:19:09.651 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-17T14:19:09.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:19:09.770 INFO:teuthology.dispatcher.supervisor:Running job 7660317 2024-04-17T14:19:09.770 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660317 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660317/orig.config.yaml 2024-04-17T14:19:09.773 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660317 2024-04-17T14:19:09.773 INFO:teuthology.dispatcher.supervisor:Job PID: 1344325 2024-04-17T14:19:09.773 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T14:21:09.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:23:10.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:25:10.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:27:10.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:29:10.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:31:10.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:33:10.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:35:11.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:35:11.172 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1