2024-02-20T07:29:34.737 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T07:29:34.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:29:34.876 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f154d1d0c10>, signals=[15]) 2024-02-20T07:29:34.877 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-02-20T07:29:34.877 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:29:34.877 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-02-20T07:29:34.906 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2024-02-20T07:29:34.906 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:29:34.906 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-02-20T07:29:35.024 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:29:35.040 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:29:35.065 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream 2024-02-20T07:29:35.084 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2024-02-20T07:29:35.324 INFO:teuthology.orchestra.console.smithi179:Power off 2024-02-20T07:29:35.324 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:29:35.337 INFO:teuthology.orchestra.console.smithi187:Power off 2024-02-20T07:29:35.338 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:29:35.360 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-02-20T07:29:35.360 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:35.369 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-02-20T07:29:35.369 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:35.382 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-20T07:29:35.391 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-02-20T07:29:39.385 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:39.392 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:39.495 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-20T07:29:39.502 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-02-20T07:29:43.500 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:43.507 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:43.610 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-02-20T07:29:43.615 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-02-20T07:29:43.711 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-02-20T07:29:43.716 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-02-20T07:29:43.812 INFO:teuthology.orchestra.console.smithi179:Power on 2024-02-20T07:29:43.812 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:29:43.820 INFO:teuthology.orchestra.console.smithi187:Power on 2024-02-20T07:29:43.820 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:29:43.834 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-02-20T07:29:43.835 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:43.843 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2024-02-20T07:29:43.843 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:43.856 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-02-20T07:29:43.864 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-02-20T07:29:47.861 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:47.868 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:47.971 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-02-20T07:29:47.977 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-02-20T07:29:51.976 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:51.984 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:29:52.086 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-20T07:29:52.093 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-02-20T07:29:52.187 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-02-20T07:29:52.194 INFO:teuthology.orchestra.console.smithi187:Power on completed 2024-02-20T07:29:52.288 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-02-20T07:29:52.295 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2024-02-20T07:32:23.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:23.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:26.364 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-20T07:32:26.364 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:32:32.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:32.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:35.456 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-20T07:32:35.456 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:32:41.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:41.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:44.540 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-20T07:32:44.540 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:32:50.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:50.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:53.628 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:32:53.628 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-20T07:32:59.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:32:59.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:33:02.720 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:33:02.720 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-20T07:33:08.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:33:08.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:33:11.804 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:33:11.804 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-20T07:33:17.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:33:17.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:33:36.188 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:33:42.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:33:45.280 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:33:51.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:33:54.364 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-02-20T07:34:00.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:34:00.651 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:34:00.651 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:34:17.813 WARNING:teuthology.provision.fog.smithi179:timed out 2024-02-20T07:34:21.117 INFO:teuthology.provision.fog.smithi187:Node is ready 2024-02-20T07:34:21.118 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2024-02-20T07:34:21.136 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2024-02-20T07:34:21.136 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2024-02-20T07:34:21.194 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2024-02-20T07:34:21.195 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-02-20T07:34:21.329 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2024-02-20T07:34:21.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2024-02-20T07:34:21.430 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2024-02-20T07:34:21.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-02-20T07:34:21.570 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-02-20T07:34:21.625 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-02-20T07:34:21.625 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:34:21.626 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:34:21.627 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2024-02-20T07:34:21.628 DEBUG:teuthology.parallel:result is None 2024-02-20T07:34:23.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:34:24.084 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:34:24.084 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:34:24.434 INFO:teuthology.provision.fog.smithi179:Node is ready 2024-02-20T07:34:24.434 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2024-02-20T07:34:24.448 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2024-02-20T07:34:24.449 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2024-02-20T07:34:24.504 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2024-02-20T07:34:24.504 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-02-20T07:34:24.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2024-02-20T07:34:24.655 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2024-02-20T07:34:24.723 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2024-02-20T07:34:24.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-02-20T07:34:24.856 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-02-20T07:34:24.911 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-02-20T07:34:24.911 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-02-20T07:34:24.911 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-02-20T07:34:24.911 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:34:24.911 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-02-20T07:34:24.911 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:34:24.912 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:34:24.912 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2024-02-20T07:34:24.913 DEBUG:teuthology.parallel:result is None 2024-02-20T07:34:25.108 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2024-02-20T07:34:25.108 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:34:25.135 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2024-02-20T07:34:25.136 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:34:25.161 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:34:25.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-02-20T07:34:25.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:34:25.253 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-02-20T07:34:25.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-02-20T07:34:25.319 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-02-20T07:34:25.373 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-02-20T07:34:25.374 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-02-20T07:34:25.428 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-02-20T07:34:25.428 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-02-20T07:34:25.428 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:34:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:34:25.430 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-02-20T07:34:25.452 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:34:25.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-02-20T07:34:25.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:34:25.542 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-02-20T07:34:25.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-02-20T07:34:25.613 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-02-20T07:34:25.669 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-02-20T07:34:25.670 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-02-20T07:34:25.725 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-02-20T07:34:25.725 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:34:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:34:25.727 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-02-20T07:34:25.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:34:25.845 INFO:teuthology.dispatcher.supervisor:Running job 7568533 2024-02-20T07:34:25.846 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568533 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568533/orig.config.yaml 2024-02-20T07:34:25.849 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568533 2024-02-20T07:34:25.850 INFO:teuthology.dispatcher.supervisor:Job PID: 2923830 2024-02-20T07:34:25.850 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T07:36:25.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:38:26.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:40:26.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:42:26.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:44:26.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:46:26.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:48:27.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:50:27.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:52:27.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:54:27.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:56:27.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:58:28.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:00:28.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:02:28.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:04:28.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:06:28.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:08:28.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:10:29.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:12:29.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:14:29.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:16:29.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:18:29.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:20:29.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:22:30.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:24:30.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:26:30.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:28:30.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:30:30.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:32:30.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:34:30.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:36:31.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:38:31.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:40:31.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:42:31.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:44:31.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:46:32.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:48:32.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:50:32.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:52:32.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:54:32.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:56:32.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:58:33.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:00:33.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:02:33.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:04:33.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:06:33.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:08:33.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:10:33.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:12:34.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:14:34.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:16:34.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:18:34.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:20:34.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:22:34.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:24:35.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:26:35.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:28:35.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:30:35.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:32:35.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:34:35.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:36:36.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:38:36.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:40:36.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:42:36.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:44:36.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:46:37.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:48:37.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:50:37.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:52:37.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:54:37.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:56:37.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:58:38.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:00:38.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:02:38.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:04:38.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:06:38.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:08:38.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:10:39.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:12:39.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:14:39.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:16:39.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:18:39.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:20:39.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:22:40.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:22:40.201 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1