2024-03-20T19:07:29.167 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-20T19:07:29.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:07:29.338 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2da24cdf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2da352ec10>, signals=[15])
2024-03-20T19:07:29.338 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging
2024-03-20T19:07:29.339 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T19:07:29.339 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2024-03-20T19:07:29.359 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2024-03-20T19:07:29.360 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T19:07:29.360 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2024-03-20T19:07:29.384 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging
2024-03-20T19:07:29.384 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T19:07:29.384 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-03-20T19:07:29.478 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T19:07:29.498 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T19:07:29.516 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T19:07:29.519 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream
2024-03-20T19:07:29.540 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream
2024-03-20T19:07:29.560 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream
2024-03-20T19:07:29.760 INFO:teuthology.orchestra.console.smithi115:Power off
2024-03-20T19:07:29.760 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T19:07:29.770 INFO:teuthology.orchestra.console.smithi059:Power off
2024-03-20T19:07:29.771 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T19:07:29.785 INFO:teuthology.orchestra.console.smithi179:Power off
2024-03-20T19:07:29.785 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T19:07:29.793 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2024-03-20T19:07:29.793 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:29.800 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2024-03-20T19:07:29.801 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:29.809 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2024-03-20T19:07:29.809 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:29.817 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-03-20T19:07:29.823 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-03-20T19:07:29.832 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-03-20T19:07:33.822 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:33.830 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:33.838 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:33.932 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-03-20T19:07:33.940 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-03-20T19:07:33.946 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-03-20T19:07:37.934 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:37.942 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:37.948 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:38.044 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-03-20T19:07:38.050 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-03-20T19:07:38.056 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-03-20T19:07:38.152 INFO:teuthology.orchestra.console.smithi115:Power off completed
2024-03-20T19:07:38.157 INFO:teuthology.orchestra.console.smithi179:Power off completed
2024-03-20T19:07:38.253 INFO:teuthology.orchestra.console.smithi115:Power on
2024-03-20T19:07:38.253 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T19:07:38.261 INFO:teuthology.orchestra.console.smithi179:Power on
2024-03-20T19:07:38.261 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T19:07:38.274 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2024-03-20T19:07:38.274 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:38.282 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On
2024-03-20T19:07:38.283 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:38.298 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-03-20T19:07:38.306 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-03-20T19:07:42.046 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:42.155 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-03-20T19:07:42.256 INFO:teuthology.orchestra.console.smithi059:Power off completed
2024-03-20T19:07:42.299 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:42.307 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:42.357 INFO:teuthology.orchestra.console.smithi059:Power on
2024-03-20T19:07:42.357 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T19:07:42.381 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On
2024-03-20T19:07:42.382 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:42.404 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-03-20T19:07:42.409 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-03-20T19:07:42.416 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-03-20T19:07:46.409 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:46.416 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:46.423 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T19:07:46.518 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-03-20T19:07:46.525 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-03-20T19:07:46.532 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-03-20T19:07:46.619 INFO:teuthology.orchestra.console.smithi059:Power on completed
2024-03-20T19:07:46.626 INFO:teuthology.orchestra.console.smithi115:Power on completed
2024-03-20T19:07:46.632 INFO:teuthology.orchestra.console.smithi179:Power on completed
2024-03-20T19:07:46.720 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2024-03-20T19:07:46.727 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2024-03-20T19:07:46.733 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2024-03-20T19:10:17.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:17.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:20.606 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-20T19:10:20.607 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-03-20T19:10:26.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:26.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:30.014 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-03-20T19:10:30.015 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-20T19:10:32.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:35.646 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-03-20T19:10:36.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:36.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:39.070 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-03-20T19:10:39.071 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-20T19:10:41.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:44.734 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-03-20T19:10:45.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:45.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:48.126 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-03-20T19:10:48.127 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-20T19:10:50.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:53.794 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-03-20T19:10:54.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:54.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:10:57.182 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-03-20T19:10:57.183 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-20T19:10:59.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:11:02.878 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-03-20T19:11:03.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:11:03.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:11:06.239 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-03-20T19:11:08.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:11:11.934 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-03-20T19:11:12.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:11:17.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:11:21.022 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-03-20T19:11:27.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:12:03.223 WARNING:teuthology.provision.fog.smithi059:timed out
2024-03-20T19:12:09.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:12:09.509 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T19:12:09.509 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T19:12:09.900 INFO:teuthology.provision.fog.smithi059:Node is ready
2024-03-20T19:12:09.900 DEBUG:teuthology.orchestra.run.smithi059:> hostname
2024-03-20T19:12:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2024-03-20T19:12:09.916 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts
2024-03-20T19:12:09.971 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2024-03-20T19:12:09.972 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2024-03-20T19:12:10.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts
2024-03-20T19:12:10.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts
2024-03-20T19:12:10.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname
2024-03-20T19:12:10.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2024-03-20T19:12:10.352 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2024-03-20T19:12:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon"
2024-03-20T19:12:10.408 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T19:12:10.408 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2024-03-20T19:12:10.408 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T19:12:10.408 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T19:12:10.408 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T19:12:10.409 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2024-03-20T19:12:10.410 DEBUG:teuthology.parallel:result is None
2024-03-20T19:12:12.245 WARNING:teuthology.provision.fog.smithi179:timed out
2024-03-20T19:12:18.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:12:18.706 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T19:12:18.706 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T19:12:19.022 INFO:teuthology.provision.fog.smithi179:Node is ready
2024-03-20T19:12:19.023 DEBUG:teuthology.orchestra.run.smithi179:> hostname
2024-03-20T19:12:19.037 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2024-03-20T19:12:19.037 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts
2024-03-20T19:12:19.093 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2024-03-20T19:12:19.094 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-03-20T19:12:19.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts
2024-03-20T19:12:19.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts
2024-03-20T19:12:19.295 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname
2024-03-20T19:12:19.363 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-03-20T19:12:19.430 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-03-20T19:12:19.485 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream"
2024-03-20T19:12:19.485 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9"
2024-03-20T19:12:19.485 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos"
2024-03-20T19:12:19.485 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora"
2024-03-20T19:12:19.485 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9"
2024-03-20T19:12:19.485 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9"
2024-03-20T19:12:19.485 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T19:12:19.486 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2024-03-20T19:12:19.486 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon"
2024-03-20T19:12:19.486 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T19:12:19.486 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/"
2024-03-20T19:12:19.486 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T19:12:19.486 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T19:12:19.486 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T19:12:19.486 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2024-03-20T19:12:19.487 DEBUG:teuthology.parallel:result is None
2024-03-20T19:12:27.038 WARNING:teuthology.provision.fog.smithi115:timed out
2024-03-20T19:12:33.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:12:33.268 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T19:12:33.268 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T19:12:33.585 INFO:teuthology.provision.fog.smithi115:Node is ready
2024-03-20T19:12:33.585 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2024-03-20T19:12:33.600 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2024-03-20T19:12:33.600 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts
2024-03-20T19:12:33.655 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2024-03-20T19:12:33.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2024-03-20T19:12:33.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts
2024-03-20T19:12:33.814 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts
2024-03-20T19:12:33.881 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname
2024-03-20T19:12:33.948 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2024-03-20T19:12:34.014 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2024-03-20T19:12:34.069 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2024-03-20T19:12:34.070 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon"
2024-03-20T19:12:34.071 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T19:12:34.071 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2024-03-20T19:12:34.071 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T19:12:34.071 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T19:12:34.071 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T19:12:34.071 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2024-03-20T19:12:34.072 DEBUG:teuthology.parallel:result is None
2024-03-20T19:12:34.287 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2024-03-20T19:12:34.287 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T19:12:34.314 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2024-03-20T19:12:34.314 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T19:12:34.330 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2024-03-20T19:12:34.331 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T19:12:34.349 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2024-03-20T19:12:34.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2024-03-20T19:12:34.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:12:34.454 DEBUG:teuthology.orchestra.run.smithi059:> true
2024-03-20T19:12:34.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com'
2024-03-20T19:12:34.637 DEBUG:teuthology.orchestra.run.smithi059:> uname -m
2024-03-20T19:12:34.692 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2024-03-20T19:12:34.693 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2024-03-20T19:12:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2024-03-20T19:12:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9"
2024-03-20T19:12:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2024-03-20T19:12:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2024-03-20T19:12:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9"
2024-03-20T19:12:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T19:12:34.748 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T19:12:34.749 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2024-03-20T19:12:34.772 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2024-03-20T19:12:34.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2024-03-20T19:12:34.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:12:34.858 DEBUG:teuthology.orchestra.run.smithi115:> true
2024-03-20T19:12:34.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com'
2024-03-20T19:12:34.925 DEBUG:teuthology.orchestra.run.smithi115:> uname -m
2024-03-20T19:12:34.980 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2024-03-20T19:12:34.980 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2024-03-20T19:12:35.034 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T19:12:35.035 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T19:12:35.036 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2024-03-20T19:12:35.056 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2024-03-20T19:12:35.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-03-20T19:12:35.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T19:12:35.142 DEBUG:teuthology.orchestra.run.smithi179:> true
2024-03-20T19:12:35.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-03-20T19:12:35.312 DEBUG:teuthology.orchestra.run.smithi179:> uname -m
2024-03-20T19:12:35.367 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2024-03-20T19:12:35.367 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-03-20T19:12:35.422 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream"
2024-03-20T19:12:35.422 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9"
2024-03-20T19:12:35.422 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos"
2024-03-20T19:12:35.422 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora"
2024-03-20T19:12:35.422 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9"
2024-03-20T19:12:35.422 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9"
2024-03-20T19:12:35.422 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T19:12:35.423 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2024-03-20T19:12:35.423 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon"
2024-03-20T19:12:35.423 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T19:12:35.423 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/"
2024-03-20T19:12:35.423 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T19:12:35.423 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T19:12:35.423 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T19:12:35.423 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-03-20T19:12:35.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:12:35.572 INFO:teuthology.dispatcher.supervisor:Running job 7612955
2024-03-20T19:12:35.573 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612955 --name pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612955/orig.config.yaml
2024-03-20T19:12:35.576 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612955
2024-03-20T19:12:35.577 INFO:teuthology.dispatcher.supervisor:Job PID: 3790078
2024-03-20T19:12:35.577 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-20T19:14:35.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:16:35.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:18:36.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:20:36.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:22:36.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:24:36.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:26:36.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:28:36.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:30:37.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:32:37.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:34:37.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:36:37.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:38:37.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:40:37.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:42:38.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:44:38.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:46:38.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:48:38.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:48:38.674 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-03-20T19:48:38.912 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi059 but it was locked by another job: /home/teuthworker/archive/gabrioux-2024-03-20_19:16:31-orch:cephadm-wip-guits-testing-2024-03-20-1259-distro-default-smithi/7613453
2024-03-20T19:48:38.912 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi115 but it was locked by another job: /home/teuthworker/archive/gabrioux-2024-03-20_19:16:31-orch:cephadm-wip-guits-testing-2024-03-20-1259-distro-default-smithi/7613455
2024-03-20T19:48:38.912 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi179 but it was locked by another job: /home/teuthworker/archive/gabrioux-2024-03-20_19:16:31-orch:cephadm-wip-guits-testing-2024-03-20-1259-distro-default-smithi/7613454