2024-02-19T18:29:54.821 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T18:29:54.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:29:54.961 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b83620c10>, signals=[15]) 2024-02-19T18:29:54.961 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2024-02-19T18:29:54.962 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:54.962 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-02-19T18:29:56.198 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-02-19T18:29:56.198 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:56.198 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-02-19T18:29:56.328 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:56.334 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:56.381 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream 2024-02-19T18:29:56.383 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream 2024-02-19T18:29:56.956 INFO:teuthology.orchestra.console.smithi086:Power off 2024-02-19T18:29:56.956 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:29:56.969 INFO:teuthology.orchestra.console.smithi039:Power off 2024-02-19T18:29:56.969 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:29:56.978 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-02-19T18:29:56.978 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:56.991 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-02-19T18:29:56.991 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:56.999 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-19T18:29:57.012 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-19T18:30:01.004 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:01.013 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:01.113 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-19T18:30:01.122 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-19T18:30:05.119 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:05.126 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:05.228 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-19T18:30:05.234 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-19T18:30:05.329 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-02-19T18:30:05.430 INFO:teuthology.orchestra.console.smithi086:Power on 2024-02-19T18:30:05.430 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:30:05.450 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-02-19T18:30:05.451 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:05.470 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-19T18:30:09.237 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:09.346 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-19T18:30:09.447 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-02-19T18:30:09.471 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:09.548 INFO:teuthology.orchestra.console.smithi039:Power on 2024-02-19T18:30:09.548 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:30:09.568 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2024-02-19T18:30:09.568 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:09.579 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-19T18:30:09.587 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-19T18:30:09.680 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-02-19T18:30:09.781 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-02-19T18:30:13.592 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:13.700 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-19T18:30:17.704 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:17.814 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-19T18:30:17.915 INFO:teuthology.orchestra.console.smithi039:Power on completed 2024-02-19T18:30:18.015 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2024-02-19T18:35:21.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:24.284 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:35:30.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:33.372 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:35:39.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:42.428 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:35:48.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:51.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:51.484 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:35:54.492 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-19T18:35:57.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:00.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:00.540 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:36:03.548 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-19T18:36:06.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:09.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:09.596 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:36:12.604 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-19T18:36:15.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:18.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:18.652 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:36:21.660 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-19T18:36:24.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:27.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:27.708 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:36:30.716 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-19T18:36:33.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:36.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:36.764 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-19T18:36:39.772 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-19T18:36:42.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:45.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:42.828 WARNING:teuthology.provision.fog.smithi039:timed out 2024-02-19T18:37:45.782 WARNING:teuthology.provision.fog.smithi086:timed out 2024-02-19T18:37:48.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:49.087 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:37:49.088 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:37:49.403 INFO:teuthology.provision.fog.smithi039:Node is ready 2024-02-19T18:37:49.403 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2024-02-19T18:37:49.419 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2024-02-19T18:37:49.419 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2024-02-19T18:37:49.475 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2024-02-19T18:37:49.475 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-02-19T18:37:49.614 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2024-02-19T18:37:49.646 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2024-02-19T18:37:49.718 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2024-02-19T18:37:49.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-02-19T18:37:49.859 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-02-19T18:37:49.913 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-02-19T18:37:49.913 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:49.914 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:49.915 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:49.915 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2024-02-19T18:37:49.917 DEBUG:teuthology.parallel:result is None 2024-02-19T18:37:51.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:52.000 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:37:52.001 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:37:52.327 INFO:teuthology.provision.fog.smithi086:Node is ready 2024-02-19T18:37:52.328 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2024-02-19T18:37:52.342 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2024-02-19T18:37:52.342 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2024-02-19T18:37:52.398 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2024-02-19T18:37:52.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-02-19T18:37:52.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2024-02-19T18:37:52.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2024-02-19T18:37:52.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2024-02-19T18:37:52.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-02-19T18:37:52.737 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:52.792 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2024-02-19T18:37:52.792 DEBUG:teuthology.parallel:result is None 2024-02-19T18:37:52.960 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2024-02-19T18:37:52.960 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:37:52.989 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2024-02-19T18:37:52.989 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:37:53.006 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:37:53.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-19T18:37:53.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:53.108 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-02-19T18:37:53.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-19T18:37:53.180 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-02-19T18:37:53.235 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-02-19T18:37:53.236 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-02-19T18:37:53.291 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-02-19T18:37:53.291 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-02-19T18:37:53.291 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-02-19T18:37:53.291 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:53.291 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:53.292 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:53.293 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-02-19T18:37:53.314 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:37:53.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-02-19T18:37:53.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:53.398 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-02-19T18:37:53.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-02-19T18:37:53.461 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-02-19T18:37:53.515 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-02-19T18:37:53.516 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:53.570 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:53.571 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:53.571 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:53.571 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:53.571 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:53.571 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:53.571 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:53.571 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-02-19T18:37:53.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:37:53.823 INFO:teuthology.dispatcher.supervisor:Running job 7566631 2024-02-19T18:37:53.823 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566631 --name pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566631/orig.config.yaml 2024-02-19T18:37:53.826 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566631 2024-02-19T18:37:53.826 INFO:teuthology.dispatcher.supervisor:Job PID: 3452698 2024-02-19T18:37:53.827 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T18:39:53.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:41:54.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:43:54.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:45:54.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:47:54.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:49:54.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:51:55.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:53:55.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:55:55.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:57:55.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:59:55.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:01:55.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:03:55.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:05:56.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:07:56.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:09:56.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:11:56.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:13:56.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:15:56.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:17:57.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:19:57.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:21:57.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:23:57.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:25:57.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:27:57.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:29:58.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:31:58.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:33:58.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:35:58.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:37:58.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:39:58.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:41:58.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:43:59.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:45:59.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:47:59.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:49:59.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:51:59.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:54:00.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:56:00.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:58:00.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:00:00.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:02:00.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:04:00.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:06:00.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:08:01.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:10:01.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:12:01.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:14:01.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:16:01.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:18:01.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:20:02.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:22:02.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:24:02.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:26:02.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:28:02.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:30:02.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:32:03.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:34:03.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:36:03.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:38:03.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:38:03.754 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1