2024-04-13T07:15:38.683 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-13T07:15:38.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:15:38.838 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff1d3d9cc10>, signals=[15]) 2024-04-13T07:15:38.838 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2024-04-13T07:15:38.838 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T07:15:38.839 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-13T07:15:38.864 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2024-04-13T07:15:38.865 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T07:15:38.865 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-13T07:15:38.999 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10) 2024-04-13T07:15:39.007 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2024-04-13T07:15:39.046 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2024-04-13T07:15:39.049 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream 2024-04-13T07:15:39.265 INFO:teuthology.orchestra.console.smithi111:Power off 2024-04-13T07:15:39.265 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T07:15:39.277 INFO:teuthology.orchestra.console.smithi156:Power off 2024-04-13T07:15:39.278 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T07:15:39.288 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-04-13T07:15:39.288 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T07:15:39.299 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-04-13T07:15:39.300 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T07:15:39.312 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-13T07:15:39.324 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-13T07:15:39.413 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-04-13T07:15:39.425 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-04-13T07:15:39.514 INFO:teuthology.orchestra.console.smithi111:Power on 2024-04-13T07:15:39.514 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T07:15:39.526 INFO:teuthology.orchestra.console.smithi156:Power on 2024-04-13T07:15:39.526 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T07:15:39.540 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2024-04-13T07:15:39.540 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T07:15:39.549 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2024-04-13T07:15:39.550 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T07:15:39.563 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-13T07:15:39.570 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-13T07:15:43.568 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T07:15:43.576 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T07:15:43.679 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-13T07:15:43.685 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-13T07:15:43.780 INFO:teuthology.orchestra.console.smithi111:Power on completed 2024-04-13T07:15:43.881 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2024-04-13T07:15:47.689 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T07:15:47.913 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-04-13T07:15:48.013 INFO:teuthology.orchestra.console.smithi156:Power on completed 2024-04-13T07:15:48.114 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2024-04-13T07:18:29.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:18:32.802 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:18:33.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:18:36.926 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-13T07:18:38.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:18:41.886 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:18:42.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:18:45.982 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-13T07:18:47.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:18:50.942 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:18:51.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:18:55.038 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-13T07:18:56.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:18:59.998 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:19:01.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:04.098 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-13T07:19:05.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:09.054 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:19:10.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:13.182 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-13T07:19:15.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:18.110 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:19:19.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:22.239 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-13T07:19:24.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:27.170 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:19:28.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:31.295 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-13T07:19:33.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:36.254 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-13T07:19:37.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:19:42.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:20:37.356 WARNING:teuthology.provision.fog.smithi156:timed out 2024-04-13T07:20:42.266 WARNING:teuthology.provision.fog.smithi111:timed out 2024-04-13T07:20:43.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:20:43.591 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T07:20:43.592 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T07:20:43.904 INFO:teuthology.provision.fog.smithi156:Node is ready 2024-04-13T07:20:43.905 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2024-04-13T07:20:43.919 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2024-04-13T07:20:43.919 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2024-04-13T07:20:43.974 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2024-04-13T07:20:43.974 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-04-13T07:20:44.093 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2024-04-13T07:20:44.120 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2024-04-13T07:20:44.187 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2024-04-13T07:20:44.254 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-04-13T07:20:44.320 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-13T07:20:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-04-13T07:20:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-13T07:20:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T07:20:44.376 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2024-04-13T07:20:44.378 DEBUG:teuthology.parallel:result is None 2024-04-13T07:20:48.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:20:48.532 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T07:20:48.532 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T07:20:48.858 INFO:teuthology.provision.fog.smithi111:Node is ready 2024-04-13T07:20:48.858 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2024-04-13T07:20:48.873 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2024-04-13T07:20:48.873 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2024-04-13T07:20:48.928 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2024-04-13T07:20:48.929 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-04-13T07:20:49.030 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2024-04-13T07:20:49.059 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2024-04-13T07:20:49.127 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2024-04-13T07:20:49.193 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-04-13T07:20:49.260 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T07:20:49.314 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-13T07:20:49.315 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T07:20:49.315 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2024-04-13T07:20:49.315 DEBUG:teuthology.parallel:result is None 2024-04-13T07:20:49.480 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2024-04-13T07:20:49.481 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T07:20:49.508 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2024-04-13T07:20:49.508 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T07:20:49.526 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2024-04-13T07:20:49.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-13T07:20:49.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:20:49.615 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-13T07:20:49.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-13T07:20:49.680 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-04-13T07:20:49.734 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-04-13T07:20:49.735 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-13T07:20:49.788 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-04-13T07:20:49.788 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-13T07:20:49.789 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T07:20:49.790 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-13T07:20:49.808 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2024-04-13T07:20:49.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-13T07:20:49.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T07:20:49.894 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-04-13T07:20:49.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-13T07:20:49.966 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-04-13T07:20:50.022 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-04-13T07:20:50.023 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-04-13T07:20:50.078 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-13T07:20:50.079 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-04-13T07:20:50.079 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T07:20:50.079 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-13T07:20:50.079 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T07:20:50.079 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-13T07:20:50.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:20:50.198 INFO:teuthology.dispatcher.supervisor:Running job 7654946 2024-04-13T07:20:50.198 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-13_03:08:05-upgrade-main-distro-default-smithi/7654946 --name teuthology-2024-04-13_03:08:05-upgrade-main-distro-default-smithi --description upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-04-13_03:08:05-upgrade-main-distro-default-smithi/7654946/orig.config.yaml 2024-04-13T07:20:50.202 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-13_03:08:05-upgrade-main-distro-default-smithi/7654946 2024-04-13T07:20:50.202 INFO:teuthology.dispatcher.supervisor:Job PID: 3136036 2024-04-13T07:20:50.202 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-13T07:22:50.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:24:50.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:26:50.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:28:50.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:30:51.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:32:51.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:34:51.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:36:51.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:38:51.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:40:51.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:42:52.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:44:52.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:46:52.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:48:52.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:50:52.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:52:52.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:54:53.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:56:53.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T07:58:53.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:00:53.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:02:53.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:04:53.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:06:54.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:08:54.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:10:54.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:12:54.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:14:54.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:16:54.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:18:55.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:20:55.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:22:55.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:24:55.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:26:55.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:28:55.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:30:56.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:32:56.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T08:32:56.386 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1