2024-02-26T07:41:35.740 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-26T07:41:35.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T07:41:35.883 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6f1eb6e50>, signals=[15]) 2024-02-26T07:41:35.884 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-02-26T07:41:35.884 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-02-26T07:41:35.884 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-26T07:41:35.905 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-02-26T07:41:35.905 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-02-26T07:41:35.905 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-26T07:41:36.012 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2024-02-26T07:41:36.034 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10) 2024-02-26T07:41:36.053 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2024-02-26T07:41:36.083 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream 2024-02-26T07:41:36.301 INFO:teuthology.orchestra.console.smithi084:Power off 2024-02-26T07:41:36.301 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-26T07:41:36.314 INFO:teuthology.orchestra.console.smithi099:Power off 2024-02-26T07:41:36.315 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-26T07:41:36.323 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-02-26T07:41:36.324 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T07:41:36.336 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-02-26T07:41:36.337 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T07:41:36.348 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-26T07:41:36.358 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-26T07:41:36.449 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-02-26T07:41:36.459 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-02-26T07:41:36.550 INFO:teuthology.orchestra.console.smithi084:Power on 2024-02-26T07:41:36.550 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-26T07:41:36.561 INFO:teuthology.orchestra.console.smithi099:Power on 2024-02-26T07:41:36.561 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-26T07:41:36.571 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-02-26T07:41:36.571 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T07:41:36.587 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-02-26T07:41:36.587 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T07:41:36.596 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-26T07:41:36.609 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-26T07:41:40.599 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T07:41:40.610 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T07:41:40.709 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-26T07:41:40.721 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-26T07:41:40.810 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-02-26T07:41:40.911 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-02-26T07:41:44.724 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T07:41:44.833 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-26T07:41:44.934 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-02-26T07:41:45.035 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-02-26T07:44:15.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:44:16.040 ERROR:teuthology.orchestra.connection:Error authenticating with smithi099.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-26T07:44:26.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:44:29.820 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-26T07:44:35.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:44:38.876 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-26T07:44:44.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:44:47.936 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-26T07:44:53.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:44:56.992 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-26T07:45:02.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:45:06.044 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-26T07:45:12.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:45:15.100 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-26T07:45:20.043 WARNING:teuthology.provision.fog.smithi099:timed out 2024-02-26T07:45:21.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:45:26.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:46:21.104 WARNING:teuthology.provision.fog.smithi084:timed out 2024-02-26T07:46:26.046 WARNING:teuthology.provision.fog.smithi099:timed out 2024-02-26T07:46:27.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:46:27.574 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-26T07:46:27.575 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-26T07:46:27.903 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-02-26T07:46:27.903 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-02-26T07:46:27.918 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-02-26T07:46:27.918 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-02-26T07:46:27.976 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-02-26T07:46:27.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-26T07:46:28.093 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-02-26T07:46:28.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-02-26T07:46:28.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-02-26T07:46:28.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-26T07:46:28.332 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-26T07:46:28.390 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-02-26T07:46:28.391 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-26T07:46:28.392 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-26T07:46:28.392 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-26T07:46:28.393 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-02-26T07:46:28.394 DEBUG:teuthology.parallel:result is None 2024-02-26T07:46:32.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:46:32.311 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-26T07:46:32.312 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-26T07:46:32.639 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-02-26T07:46:32.639 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-02-26T07:46:32.653 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-02-26T07:46:32.653 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-02-26T07:46:32.706 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-02-26T07:46:32.707 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-26T07:46:32.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-02-26T07:46:32.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-02-26T07:46:32.911 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-02-26T07:46:32.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-26T07:46:33.046 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-26T07:46:33.101 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-26T07:46:33.102 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-02-26T07:46:33.102 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-26T07:46:33.102 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-26T07:46:33.102 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-26T07:46:33.102 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-26T07:46:33.102 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-26T07:46:33.102 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-02-26T07:46:33.103 DEBUG:teuthology.parallel:result is None 2024-02-26T07:46:33.263 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-02-26T07:46:33.263 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-26T07:46:33.285 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-02-26T07:46:33.285 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-26T07:46:33.302 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-02-26T07:46:33.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-26T07:46:33.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:46:33.387 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-02-26T07:46:33.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-26T07:46:33.455 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-02-26T07:46:33.511 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-02-26T07:46:33.511 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-02-26T07:46:33.566 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-02-26T07:46:33.567 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-26T07:46:33.567 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-02-26T07:46:33.567 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-26T07:46:33.567 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-26T07:46:33.567 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-26T07:46:33.567 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-26T07:46:33.585 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-02-26T07:46:33.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-26T07:46:33.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T07:46:33.669 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-26T07:46:33.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-26T07:46:33.734 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-02-26T07:46:33.787 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-02-26T07:46:33.787 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-26T07:46:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-26T07:46:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-02-26T07:46:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-26T07:46:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-26T07:46:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-26T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-26T07:46:33.842 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-26T07:46:33.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T07:46:33.953 INFO:teuthology.dispatcher.supervisor:Running job 7573510 2024-02-26T07:46:33.953 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-26_06:35:56-fs:upgrade-wip-64502-testing-default-smithi/7573510 --name vshankar-2024-02-26_06:35:56-fs:upgrade-wip-64502-testing-default-smithi --description fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-02-26_06:35:56-fs:upgrade-wip-64502-testing-default-smithi/7573510/orig.config.yaml 2024-02-26T07:46:33.957 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-26_06:35:56-fs:upgrade-wip-64502-testing-default-smithi/7573510 2024-02-26T07:46:33.957 INFO:teuthology.dispatcher.supervisor:Job PID: 1744839 2024-02-26T07:46:33.957 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-26T07:48:33.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T07:50:34.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T07:52:34.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T07:54:34.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T07:56:34.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T07:58:34.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:00:34.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:02:34.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:04:34.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:06:34.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:08:34.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:10:34.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:12:34.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:14:34.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:16:35.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:18:35.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:20:35.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:22:35.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:24:35.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:26:35.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:28:35.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:30:35.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:32:35.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:34:35.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:36:35.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:38:35.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:40:35.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:42:36.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:44:36.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:46:36.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:48:36.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:50:36.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:52:36.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:54:36.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:56:36.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T08:58:36.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:00:36.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:02:36.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:04:36.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:06:36.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:08:37.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:10:37.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:12:37.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:14:37.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:16:37.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:18:37.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:20:37.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:22:37.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:24:37.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:26:37.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:28:37.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:30:38.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:32:38.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:34:38.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:36:38.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:38:38.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:40:38.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:42:38.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T09:42:39.047 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1