2024-04-14T09:21:38.205 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60
2024-04-14T09:21:38.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:21:38.384 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f79aa369f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f79ab3cac10>, signals=[15])
2024-04-14T09:21:38.385 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2024-04-14T09:21:38.385 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T09:21:38.385 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2024-04-14T09:21:38.407 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2024-04-14T09:21:38.407 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T09:21:38.407 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-04-14T09:21:38.431 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2024-04-14T09:21:38.431 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T09:21:38.431 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-04-14T09:21:38.520 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T09:21:38.547 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T09:21:38.553 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T09:21:38.558 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 9.stream
2024-04-14T09:21:38.585 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 9.stream
2024-04-14T09:21:38.595 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream
2024-04-14T09:21:39.034 INFO:teuthology.orchestra.console.smithi150:Power off
2024-04-14T09:21:39.035 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T09:21:39.049 INFO:teuthology.orchestra.console.smithi050:Power off
2024-04-14T09:21:39.049 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T09:21:39.058 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-04-14T09:21:39.058 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:39.080 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2024-04-14T09:21:39.080 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:39.087 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-04-14T09:21:39.099 INFO:teuthology.orchestra.console.smithi171:Power off
2024-04-14T09:21:39.100 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T09:21:39.108 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-04-14T09:21:39.121 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off
2024-04-14T09:21:39.121 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:39.146 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-04-14T09:21:39.247 INFO:teuthology.orchestra.console.smithi171:Power off completed
2024-04-14T09:21:39.348 INFO:teuthology.orchestra.console.smithi171:Power on
2024-04-14T09:21:39.348 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T09:21:39.370 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On
2024-04-14T09:21:39.370 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:39.391 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-04-14T09:21:43.090 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:43.109 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:43.199 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-04-14T09:21:43.217 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-04-14T09:21:43.392 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:43.501 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-04-14T09:21:47.204 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:47.218 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:47.314 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-04-14T09:21:47.327 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-04-14T09:21:47.415 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-04-14T09:21:47.428 INFO:teuthology.orchestra.console.smithi050:Power off completed
2024-04-14T09:21:47.502 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:47.516 INFO:teuthology.orchestra.console.smithi150:Power on
2024-04-14T09:21:47.517 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T09:21:47.528 INFO:teuthology.orchestra.console.smithi050:Power on
2024-04-14T09:21:47.529 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T09:21:47.538 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2024-04-14T09:21:47.538 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:47.548 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On
2024-04-14T09:21:47.549 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:47.562 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-04-14T09:21:47.569 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-04-14T09:21:47.611 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-04-14T09:21:47.713 INFO:teuthology.orchestra.console.smithi171:Power on completed
2024-04-14T09:21:47.814 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2024-04-14T09:21:51.566 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:51.574 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:51.676 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-04-14T09:21:51.682 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-04-14T09:21:55.680 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:55.687 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T09:21:55.857 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-04-14T09:21:55.912 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-04-14T09:21:55.958 INFO:teuthology.orchestra.console.smithi150:Power on completed
2024-04-14T09:21:56.013 INFO:teuthology.orchestra.console.smithi050:Power on completed
2024-04-14T09:21:56.059 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2024-04-14T09:21:56.113 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2024-04-14T09:24:42.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:24:42.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:24:45.506 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:24:45.507 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-04-14T09:24:51.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:24:51.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:24:54.590 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:24:54.591 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-04-14T09:25:00.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:00.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:03.646 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:25:03.647 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-04-14T09:25:04.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:04.571 ERROR:teuthology.orchestra.connection:Error authenticating with smithi171.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-14T09:25:09.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:09.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:12.702 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:25:12.703 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-04-14T09:25:18.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:18.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:21.758 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:25:21.759 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-04-14T09:25:27.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:27.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:30.814 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:25:30.815 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-04-14T09:25:36.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:36.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:39.874 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:25:43.071 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-14T09:25:45.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:48.962 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-14T09:25:49.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:52.126 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-14T09:25:54.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:25:58.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:26:01.186 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-14T09:26:07.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:26:10.274 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-14T09:26:16.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:26:36.821 WARNING:teuthology.provision.fog.smithi050:timed out
2024-04-14T09:26:42.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:26:43.064 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T09:26:43.065 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T09:26:43.395 INFO:teuthology.provision.fog.smithi050:Node is ready
2024-04-14T09:26:43.395 DEBUG:teuthology.orchestra.run.smithi050:> hostname
2024-04-14T09:26:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2024-04-14T09:26:43.410 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts
2024-04-14T09:26:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2024-04-14T09:26:43.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-04-14T09:26:43.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts
2024-04-14T09:26:43.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts
2024-04-14T09:26:43.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname
2024-04-14T09:26:43.760 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-04-14T09:26:43.832 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2024-04-14T09:26:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2024-04-14T09:26:43.888 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T09:26:43.888 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2024-04-14T09:26:43.888 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T09:26:43.888 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T09:26:43.888 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T09:26:43.889 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2024-04-14T09:26:43.890 DEBUG:teuthology.parallel:result is None
2024-04-14T09:26:54.966 WARNING:teuthology.provision.fog.smithi150:timed out
2024-04-14T09:27:00.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:27:01.270 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T09:27:01.270 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T09:27:01.610 INFO:teuthology.provision.fog.smithi150:Node is ready
2024-04-14T09:27:01.610 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2024-04-14T09:27:01.625 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2024-04-14T09:27:01.625 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2024-04-14T09:27:01.680 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2024-04-14T09:27:01.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-04-14T09:27:01.790 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2024-04-14T09:27:01.820 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2024-04-14T09:27:01.887 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2024-04-14T09:27:01.951 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-04-14T09:27:02.018 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-04-14T09:27:02.070 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-04-14T09:27:02.070 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-04-14T09:27:02.070 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-04-14T09:27:02.070 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-04-14T09:27:02.070 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-04-14T09:27:02.070 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T09:27:02.071 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T09:27:02.071 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2024-04-14T09:27:02.072 DEBUG:teuthology.parallel:result is None
2024-04-14T09:27:16.279 WARNING:teuthology.provision.fog.smithi171:timed out
2024-04-14T09:27:22.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:27:22.538 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T09:27:22.539 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T09:27:22.861 INFO:teuthology.provision.fog.smithi171:Node is ready
2024-04-14T09:27:22.862 DEBUG:teuthology.orchestra.run.smithi171:> hostname
2024-04-14T09:27:22.876 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2024-04-14T09:27:22.876 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts
2024-04-14T09:27:22.931 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2024-04-14T09:27:22.932 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-04-14T09:27:23.041 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts
2024-04-14T09:27:23.069 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts
2024-04-14T09:27:23.136 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname
2024-04-14T09:27:23.204 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-04-14T09:27:23.271 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-04-14T09:27:23.326 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-04-14T09:27:23.327 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T09:27:23.327 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-04-14T09:27:23.327 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T09:27:23.327 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T09:27:23.327 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T09:27:23.327 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2024-04-14T09:27:23.328 DEBUG:teuthology.parallel:result is None
2024-04-14T09:27:23.542 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2024-04-14T09:27:23.542 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T09:27:23.567 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2024-04-14T09:27:23.567 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T09:27:23.592 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2024-04-14T09:27:23.592 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T09:27:23.618 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2024-04-14T09:27:23.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2024-04-14T09:27:23.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:27:23.723 DEBUG:teuthology.orchestra.run.smithi050:> true
2024-04-14T09:27:23.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com'
2024-04-14T09:27:23.909 DEBUG:teuthology.orchestra.run.smithi050:> uname -m
2024-04-14T09:27:23.964 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2024-04-14T09:27:23.964 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2024-04-14T09:27:24.019 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T09:27:24.020 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2024-04-14T09:27:24.020 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T09:27:24.020 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T09:27:24.020 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T09:27:24.020 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2024-04-14T09:27:24.043 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2024-04-14T09:27:24.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-04-14T09:27:24.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:27:24.130 DEBUG:teuthology.orchestra.run.smithi150:> true
2024-04-14T09:27:24.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-04-14T09:27:24.301 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2024-04-14T09:27:24.356 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2024-04-14T09:27:24.356 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-04-14T09:27:24.411 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T09:27:24.412 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-04-14T09:27:24.412 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T09:27:24.412 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T09:27:24.412 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T09:27:24.412 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-04-14T09:27:24.434 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2024-04-14T09:27:24.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-04-14T09:27:24.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T09:27:24.522 DEBUG:teuthology.orchestra.run.smithi171:> true
2024-04-14T09:27:24.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-04-14T09:27:24.591 DEBUG:teuthology.orchestra.run.smithi171:> uname -m
2024-04-14T09:27:24.648 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2024-04-14T09:27:24.648 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T09:27:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-04-14T09:27:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-04-14T09:27:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T09:27:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-04-14T09:27:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T09:27:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T09:27:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T09:27:24.706 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-04-14T09:27:24.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:27:24.847 INFO:teuthology.dispatcher.supervisor:Running job 7638479
2024-04-14T09:27:24.847 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638479 --name teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638479/orig.config.yaml
2024-04-14T09:27:24.851 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638479
2024-04-14T09:27:24.851 INFO:teuthology.dispatcher.supervisor:Job PID: 2465576
2024-04-14T09:27:24.851 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-14T09:29:24.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:31:24.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:33:25.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:35:25.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:37:25.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:39:25.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:41:25.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T09:41:25.340 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1