2024-04-01T15:02:33.368 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-01T15:02:33.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T15:02:33.508 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb5c6686f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb5c76e7c10>, signals=[15])
2024-04-01T15:02:33.508 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging
2024-04-01T15:02:33.508 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T15:02:33.508 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2024-04-01T15:02:33.531 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-04-01T15:02:33.532 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T15:02:33.532 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-04-01T15:02:33.638 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T15:02:33.673 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T15:02:33.679 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 9.stream
2024-04-01T15:02:33.713 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream
2024-04-01T15:02:33.901 INFO:teuthology.orchestra.console.smithi121:Power off
2024-04-01T15:02:33.901 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T15:02:33.926 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off
2024-04-01T15:02:33.927 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:33.945 INFO:teuthology.orchestra.console.smithi163:Power off
2024-04-01T15:02:33.945 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T15:02:33.954 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2024-04-01T15:02:33.966 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-04-01T15:02:33.966 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:33.989 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-01T15:02:34.090 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-04-01T15:02:34.190 INFO:teuthology.orchestra.console.smithi163:Power on
2024-04-01T15:02:34.190 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T15:02:34.213 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-04-01T15:02:34.214 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:34.235 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-01T15:02:37.958 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:38.068 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2024-04-01T15:02:38.236 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:38.345 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-01T15:02:42.073 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:42.182 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2024-04-01T15:02:42.283 INFO:teuthology.orchestra.console.smithi121:Power off completed
2024-04-01T15:02:42.347 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:42.385 INFO:teuthology.orchestra.console.smithi121:Power on
2024-04-01T15:02:42.385 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T15:02:42.406 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On
2024-04-01T15:02:42.406 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:42.428 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2024-04-01T15:02:42.457 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-04-01T15:02:42.557 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-04-01T15:02:42.658 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-04-01T15:02:42.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:02:45.790 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:02:46.430 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:46.541 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2024-04-01T15:02:50.542 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T15:02:50.651 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2024-04-01T15:02:50.752 INFO:teuthology.orchestra.console.smithi121:Power on completed
2024-04-01T15:02:50.852 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish
2024-04-01T15:02:51.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:02:54.846 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:03:00.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:03:03.902 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:03:09.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:03:12.958 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:03:18.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:03:22.015 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:03:28.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:03:31.070 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:03:37.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:03:40.126 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:03:46.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:03:49.182 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:03:55.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:03:58.242 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:04:04.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:04:07.326 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:04:13.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:04:31.778 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:04:37.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:04:38.008 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:04:44.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:04:44.140 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-01T15:04:48.266 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-01T15:04:55.399 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-01T15:05:05.522 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-01T15:05:18.642 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-01T15:05:21.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:05:40.382 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:05:46.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:05:49.438 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:05:50.942 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:05:55.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:05:56.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:05:56.958 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:05:58.494 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:06:02.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:04.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:06.014 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:06:07.550 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:06:12.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:13.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:15.070 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:06:16.606 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:06:21.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:22.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:24.126 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:06:30.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:33.182 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:06:39.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:41.054 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:06:42.238 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:06:47.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:48.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:50.110 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:06:51.294 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:06:56.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:57.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:06:59.166 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-04-01T15:07:05.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:07:05.490 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T15:07:05.490 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T15:07:15.614 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:07:21.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:07:24.670 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:07:25.847 INFO:teuthology.provision.fog.smithi121:Node is ready
2024-04-01T15:07:25.848 DEBUG:teuthology.orchestra.run.smithi121:> hostname
2024-04-01T15:07:25.865 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com
2024-04-01T15:07:25.865 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts
2024-04-01T15:07:25.922 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121
2024-04-01T15:07:25.923 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2024-04-01T15:07:26.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts
2024-04-01T15:07:26.127 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts
2024-04-01T15:07:26.196 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname
2024-04-01T15:07:26.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2024-04-01T15:07:26.333 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31"
2024-04-01T15:07:26.389 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon"
2024-04-01T15:07:26.390 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T15:07:26.390 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/"
2024-04-01T15:07:26.390 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T15:07:26.390 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T15:07:26.390 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T15:07:26.391 INFO:teuthology.provision.fog.smithi121:Deploy complete!
2024-04-01T15:07:26.392 DEBUG:teuthology.parallel:result is None
2024-04-01T15:07:30.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:07:33.726 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-01T15:07:39.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:07:40.287 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T15:07:40.288 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T15:07:56.062 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-04-01T15:07:56.063 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-04-01T15:07:56.079 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-04-01T15:07:56.080 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-04-01T15:07:56.137 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-04-01T15:07:56.138 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-04-01T15:07:56.262 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-04-01T15:07:56.292 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-04-01T15:07:56.366 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-04-01T15:07:56.439 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-04-01T15:07:56.512 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-04-01T15:07:56.572 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T15:07:56.573 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-04-01T15:07:56.573 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T15:07:56.573 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T15:07:56.573 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T15:07:56.573 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-04-01T15:07:56.574 DEBUG:teuthology.parallel:result is None
2024-04-01T15:07:56.883 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com
2024-04-01T15:07:56.883 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T15:07:56.911 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-04-01T15:07:56.912 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T15:07:56.937 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server
2024-04-01T15:07:56.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2024-04-01T15:07:56.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:07:57.031 DEBUG:teuthology.orchestra.run.smithi121:> true
2024-04-01T15:07:57.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com'
2024-04-01T15:07:57.202 DEBUG:teuthology.orchestra.run.smithi121:> uname -m
2024-04-01T15:07:57.257 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64
2024-04-01T15:07:57.258 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon"
2024-04-01T15:07:57.313 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T15:07:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/"
2024-04-01T15:07:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T15:07:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T15:07:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T15:07:57.314 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2024-04-01T15:07:57.379 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-04-01T15:07:57.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-04-01T15:07:57.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T15:07:57.467 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-04-01T15:07:57.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-04-01T15:07:57.534 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-04-01T15:07:57.589 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-04-01T15:07:57.589 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-04-01T15:07:57.643 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-04-01T15:07:57.643 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-04-01T15:07:57.643 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-04-01T15:07:57.643 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-04-01T15:07:57.643 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-04-01T15:07:57.643 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T15:07:57.644 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T15:07:57.644 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-04-01T15:07:57.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T15:07:57.757 INFO:teuthology.dispatcher.supervisor:Running job 7633911
2024-04-01T15:07:57.757 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633911 --name vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633911/orig.config.yaml
2024-04-01T15:07:57.760 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633911
2024-04-01T15:07:57.761 INFO:teuthology.dispatcher.supervisor:Job PID: 3095771
2024-04-01T15:07:57.761 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-01T15:09:57.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T15:09:57.834 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-04-01T15:09:57.953 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633913