2024-03-31T15:32:00.796 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-31T15:32:00.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:32:00.982 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde1ad49c10>, signals=[15]) 2024-03-31T15:32:00.982 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2024-03-31T15:32:00.982 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T15:32:00.982 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-03-31T15:32:01.009 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2024-03-31T15:32:01.009 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T15:32:01.009 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-03-31T15:32:01.033 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-03-31T15:32:01.033 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T15:32:01.033 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-31T15:32:01.126 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_8.stream (ID 3) 2024-03-31T15:32:01.153 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3) 2024-03-31T15:32:01.169 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2024-03-31T15:32:01.175 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream 2024-03-31T15:32:01.204 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream 2024-03-31T15:32:01.207 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2024-03-31T15:32:01.431 INFO:teuthology.orchestra.console.smithi161:Power off 2024-03-31T15:32:01.431 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T15:32:01.445 INFO:teuthology.orchestra.console.smithi131:Power off 2024-03-31T15:32:01.445 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T15:32:01.458 INFO:teuthology.orchestra.console.smithi132:Power off 2024-03-31T15:32:01.458 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T15:32:01.465 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-03-31T15:32:01.465 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:01.473 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-03-31T15:32:01.474 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:01.483 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-03-31T15:32:01.484 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:01.491 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-31T15:32:01.497 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-03-31T15:32:01.516 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-31T15:32:01.592 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-03-31T15:32:01.693 INFO:teuthology.orchestra.console.smithi161:Power on 2024-03-31T15:32:01.693 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T15:32:01.714 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-03-31T15:32:01.714 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:01.735 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-31T15:32:05.501 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:05.517 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:05.611 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-03-31T15:32:05.627 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-31T15:32:05.736 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:05.845 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-31T15:32:09.617 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:09.627 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:09.726 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-03-31T15:32:09.735 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-31T15:32:09.828 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-03-31T15:32:09.846 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:09.928 INFO:teuthology.orchestra.console.smithi131:Power on 2024-03-31T15:32:09.929 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T15:32:09.951 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2024-03-31T15:32:09.951 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:09.960 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-31T15:32:09.976 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-03-31T15:32:10.062 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-03-31T15:32:10.162 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-03-31T15:32:13.738 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:13.848 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-03-31T15:32:13.949 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-03-31T15:32:13.977 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:14.050 INFO:teuthology.orchestra.console.smithi132:Power on 2024-03-31T15:32:14.050 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T15:32:14.077 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2024-03-31T15:32:14.077 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:14.086 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-03-31T15:32:14.098 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-03-31T15:32:18.090 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:18.098 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T15:32:18.199 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-03-31T15:32:18.208 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-31T15:32:18.301 INFO:teuthology.orchestra.console.smithi131:Power on completed 2024-03-31T15:32:18.309 INFO:teuthology.orchestra.console.smithi132:Power on completed 2024-03-31T15:32:18.402 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2024-03-31T15:32:18.410 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2024-03-31T15:34:56.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:34:59.134 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-31T15:35:04.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:04.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:05.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:07.390 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-03-31T15:35:07.391 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-31T15:35:08.198 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-31T15:35:13.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:13.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:14.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:16.446 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-03-31T15:35:16.482 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-31T15:35:17.282 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-31T15:35:22.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:22.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:23.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:25.502 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-03-31T15:35:25.534 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-31T15:35:26.338 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-31T15:35:31.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:31.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:32.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:34.558 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-03-31T15:35:34.594 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-31T15:35:35.390 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-31T15:35:40.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:40.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:41.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:43.614 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-03-31T15:35:43.650 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-31T15:35:44.446 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-31T15:35:49.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:49.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:50.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:35:53.506 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-31T15:35:59.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:36:49.671 WARNING:teuthology.provision.fog.smithi131:timed out 2024-03-31T15:36:49.672 WARNING:teuthology.provision.fog.smithi132:timed out 2024-03-31T15:36:55.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:36:55.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:36:55.933 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T15:36:55.934 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T15:36:55.937 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T15:36:55.937 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T15:36:56.188 INFO:teuthology.provision.fog.smithi131:Node is ready 2024-03-31T15:36:56.188 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2024-03-31T15:36:56.207 INFO:teuthology.provision.fog.smithi132:Node is ready 2024-03-31T15:36:56.207 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2024-03-31T15:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2024-03-31T15:36:56.208 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2024-03-31T15:36:56.227 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2024-03-31T15:36:56.227 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2024-03-31T15:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2024-03-31T15:36:56.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2024-03-31T15:36:56.286 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2024-03-31T15:36:56.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-03-31T15:36:56.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2024-03-31T15:36:56.398 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2024-03-31T15:36:56.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2024-03-31T15:36:56.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2024-03-31T15:36:56.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2024-03-31T15:36:56.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2024-03-31T15:36:56.534 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2024-03-31T15:36:56.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-03-31T15:36:56.601 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-03-31T15:36:56.631 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-03-31T15:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-31T15:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-03-31T15:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T15:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-31T15:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T15:36:56.661 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2024-03-31T15:36:56.663 DEBUG:teuthology.parallel:result is None 2024-03-31T15:36:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-03-31T15:36:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2024-03-31T15:36:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-03-31T15:36:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-31T15:36:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T15:36:56.689 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2024-03-31T15:36:56.690 DEBUG:teuthology.parallel:result is None 2024-03-31T15:36:59.514 WARNING:teuthology.provision.fog.smithi161:timed out 2024-03-31T15:37:05.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:37:05.752 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T15:37:05.753 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T15:37:06.019 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-03-31T15:37:06.019 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-03-31T15:37:06.039 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-03-31T15:37:06.039 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-03-31T15:37:06.099 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-03-31T15:37:06.099 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-31T15:37:06.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-03-31T15:37:06.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-03-31T15:37:06.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-03-31T15:37:06.376 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-31T15:37:06.442 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-31T15:37:06.499 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-31T15:37:06.499 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-03-31T15:37:06.499 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-31T15:37:06.499 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-31T15:37:06.499 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-03-31T15:37:06.499 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-03-31T15:37:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-31T15:37:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-31T15:37:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-31T15:37:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-31T15:37:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T15:37:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-31T15:37:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T15:37:06.500 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-03-31T15:37:06.501 DEBUG:teuthology.parallel:result is None 2024-03-31T15:37:06.691 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2024-03-31T15:37:06.691 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T15:37:06.716 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2024-03-31T15:37:06.716 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T15:37:06.740 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-03-31T15:37:06.741 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T15:37:06.766 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2024-03-31T15:37:06.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-03-31T15:37:06.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:37:06.842 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-03-31T15:37:06.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-03-31T15:37:06.968 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-03-31T15:37:07.026 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-03-31T15:37:07.026 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-03-31T15:37:07.084 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-03-31T15:37:07.084 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2024-03-31T15:37:07.084 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-03-31T15:37:07.084 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-03-31T15:37:07.084 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-31T15:37:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T15:37:07.085 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-03-31T15:37:07.107 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2024-03-31T15:37:07.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-31T15:37:07.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:37:07.184 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-03-31T15:37:07.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-31T15:37:07.317 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-03-31T15:37:07.376 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-03-31T15:37:07.377 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-03-31T15:37:07.435 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-31T15:37:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T15:37:07.437 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-03-31T15:37:07.457 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-03-31T15:37:07.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-31T15:37:07.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T15:37:07.530 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-03-31T15:37:07.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-31T15:37:07.603 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-03-31T15:37:07.663 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-03-31T15:37:07.663 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-31T15:37:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T15:37:07.725 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-31T15:37:07.725 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T15:37:07.725 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-31T15:37:07.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:37:07.841 INFO:teuthology.dispatcher.supervisor:Running job 7631665 2024-03-31T15:37:07.841 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631665 --name vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} -- /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631665/orig.config.yaml 2024-03-31T15:37:07.845 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631665 2024-03-31T15:37:07.845 INFO:teuthology.dispatcher.supervisor:Job PID: 57487 2024-03-31T15:37:07.845 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-31T15:39:07.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:41:08.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:43:08.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:45:08.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:47:08.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:49:08.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:51:08.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:53:09.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:55:09.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:57:09.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T15:59:09.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:01:09.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:03:09.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:05:10.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:07:10.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:09:10.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:11:10.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:13:10.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:15:11.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:17:11.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:19:11.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:21:11.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:23:11.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:25:11.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:27:12.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:29:12.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:31:12.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:31:12.422 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1