2024-03-24T10:18:09.393 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-24T10:18:09.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:18:09.554 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa48ad95f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa48bdf6c10>, signals=[15])
2024-03-24T10:18:09.554 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging
2024-03-24T10:18:09.555 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T10:18:09.555 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2024-03-24T10:18:09.582 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging
2024-03-24T10:18:09.583 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T10:18:09.583 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2024-03-24T10:18:09.607 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging
2024-03-24T10:18:09.607 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T10:18:09.607 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2024-03-24T10:18:09.692 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T10:18:09.712 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T10:18:09.730 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream
2024-03-24T10:18:09.737 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T10:18:09.759 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream
2024-03-24T10:18:09.783 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream
2024-03-24T10:18:09.984 INFO:teuthology.orchestra.console.smithi008:Power off
2024-03-24T10:18:09.984 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T10:18:09.997 INFO:teuthology.orchestra.console.smithi006:Power off
2024-03-24T10:18:09.997 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T10:18:10.009 INFO:teuthology.orchestra.console.smithi012:Power off
2024-03-24T10:18:10.009 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T10:18:10.016 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off
2024-03-24T10:18:10.016 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:10.025 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off
2024-03-24T10:18:10.025 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:10.033 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off
2024-03-24T10:18:10.034 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:10.041 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off
2024-03-24T10:18:10.046 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2024-03-24T10:18:10.054 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2024-03-24T10:18:10.142 INFO:teuthology.orchestra.console.smithi008:Power off completed
2024-03-24T10:18:10.147 INFO:teuthology.orchestra.console.smithi006:Power off completed
2024-03-24T10:18:10.155 INFO:teuthology.orchestra.console.smithi012:Power off completed
2024-03-24T10:18:10.243 INFO:teuthology.orchestra.console.smithi008:Power on
2024-03-24T10:18:10.243 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T10:18:10.250 INFO:teuthology.orchestra.console.smithi006:Power on
2024-03-24T10:18:10.251 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T10:18:10.257 INFO:teuthology.orchestra.console.smithi012:Power on
2024-03-24T10:18:10.257 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T10:18:10.265 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On
2024-03-24T10:18:10.265 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:10.273 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On
2024-03-24T10:18:10.273 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:10.281 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On
2024-03-24T10:18:10.281 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:10.289 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off
2024-03-24T10:18:10.293 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2024-03-24T10:18:10.301 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2024-03-24T10:18:14.293 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:14.300 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:14.307 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:14.403 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off
2024-03-24T10:18:14.409 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on
2024-03-24T10:18:14.414 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2024-03-24T10:18:14.510 INFO:teuthology.orchestra.console.smithi006:Power on completed
2024-03-24T10:18:14.515 INFO:teuthology.orchestra.console.smithi012:Power on completed
2024-03-24T10:18:14.611 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2024-03-24T10:18:14.617 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2024-03-24T10:18:18.407 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T10:18:18.516 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on
2024-03-24T10:18:18.617 INFO:teuthology.orchestra.console.smithi008:Power on completed
2024-03-24T10:18:18.717 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2024-03-24T10:20:46.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:46.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:49.470 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-24T10:20:50.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:53.694 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:20:55.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:20:58.526 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-24T10:20:59.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:02.750 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:21:04.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:04.926 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2024-03-24T10:21:07.582 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-24T10:21:08.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:10.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:11.806 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:21:13.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:13.986 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2024-03-24T10:21:16.638 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-24T10:21:17.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:19.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:20.898 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:21:22.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:23.074 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2024-03-24T10:21:26.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:29.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:29.982 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:21:32.158 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2024-03-24T10:21:35.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:38.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:21:39.041 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:21:45.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:03.550 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:22:09.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:12.638 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-03-24T10:22:18.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:20.591 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T10:22:20.591 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T10:22:22.643 WARNING:teuthology.provision.fog.smithi012:timed out
2024-03-24T10:22:28.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:28.871 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T10:22:28.872 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T10:22:29.218 INFO:teuthology.provision.fog.smithi012:Node is ready
2024-03-24T10:22:29.219 DEBUG:teuthology.orchestra.run.smithi012:> hostname
2024-03-24T10:22:29.234 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2024-03-24T10:22:29.234 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts
2024-03-24T10:22:29.289 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2024-03-24T10:22:29.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2024-03-24T10:22:29.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts
2024-03-24T10:22:29.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts
2024-03-24T10:22:29.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname
2024-03-24T10:22:29.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2024-03-24T10:22:29.643 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2024-03-24T10:22:29.699 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T10:22:29.700 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2024-03-24T10:22:29.700 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T10:22:29.700 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T10:22:29.700 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T10:22:29.700 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2024-03-24T10:22:29.702 DEBUG:teuthology.parallel:result is None
2024-03-24T10:22:38.164 WARNING:teuthology.provision.fog.smithi006:timed out
2024-03-24T10:22:41.424 INFO:teuthology.provision.fog.smithi008:Node is ready
2024-03-24T10:22:41.425 DEBUG:teuthology.orchestra.run.smithi008:> hostname
2024-03-24T10:22:41.443 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2024-03-24T10:22:41.444 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts
2024-03-24T10:22:41.502 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2024-03-24T10:22:41.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2024-03-24T10:22:41.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts
2024-03-24T10:22:41.668 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts
2024-03-24T10:22:41.742 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname
2024-03-24T10:22:41.814 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2024-03-24T10:22:41.886 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release
2024-03-24T10:22:41.942 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream"
2024-03-24T10:22:41.942 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9"
2024-03-24T10:22:41.942 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T10:22:41.943 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T10:22:41.943 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2024-03-24T10:22:41.944 DEBUG:teuthology.parallel:result is None
2024-03-24T10:22:44.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:44.434 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T10:22:44.434 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T10:22:44.809 INFO:teuthology.provision.fog.smithi006:Node is ready
2024-03-24T10:22:44.809 DEBUG:teuthology.orchestra.run.smithi006:> hostname
2024-03-24T10:22:44.824 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2024-03-24T10:22:44.824 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts
2024-03-24T10:22:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2024-03-24T10:22:44.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006
2024-03-24T10:22:44.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts
2024-03-24T10:22:45.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts
2024-03-24T10:22:45.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname
2024-03-24T10:22:45.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006
2024-03-24T10:22:45.235 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release
2024-03-24T10:22:45.290 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream"
2024-03-24T10:22:45.290 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9"
2024-03-24T10:22:45.290 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos"
2024-03-24T10:22:45.290 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T10:22:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T10:22:45.291 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2024-03-24T10:22:45.292 DEBUG:teuthology.parallel:result is None
2024-03-24T10:22:45.518 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2024-03-24T10:22:45.518 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T10:22:45.549 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2024-03-24T10:22:45.549 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T10:22:45.573 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2024-03-24T10:22:45.573 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T10:22:45.591 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2024-03-24T10:22:45.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2024-03-24T10:22:45.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:45.692 DEBUG:teuthology.orchestra.run.smithi006:> true
2024-03-24T10:22:45.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com'
2024-03-24T10:22:45.756 DEBUG:teuthology.orchestra.run.smithi006:> uname -m
2024-03-24T10:22:45.811 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2024-03-24T10:22:45.812 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release
2024-03-24T10:22:45.866 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream"
2024-03-24T10:22:45.866 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9"
2024-03-24T10:22:45.866 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T10:22:45.867 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T10:22:45.868 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2024-03-24T10:22:45.985 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2024-03-24T10:22:45.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2024-03-24T10:22:45.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:46.085 DEBUG:teuthology.orchestra.run.smithi008:> true
2024-03-24T10:22:46.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com'
2024-03-24T10:22:46.155 DEBUG:teuthology.orchestra.run.smithi008:> uname -m
2024-03-24T10:22:46.212 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64
2024-03-24T10:22:46.212 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release
2024-03-24T10:22:46.268 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream"
2024-03-24T10:22:46.268 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T10:22:46.269 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T10:22:46.270 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2024-03-24T10:22:46.299 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2024-03-24T10:22:46.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2024-03-24T10:22:46.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T10:22:46.398 DEBUG:teuthology.orchestra.run.smithi012:> true
2024-03-24T10:22:46.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com'
2024-03-24T10:22:46.581 DEBUG:teuthology.orchestra.run.smithi012:> uname -m
2024-03-24T10:22:46.636 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2024-03-24T10:22:46.636 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2024-03-24T10:22:46.691 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2024-03-24T10:22:46.691 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2024-03-24T10:22:46.691 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2024-03-24T10:22:46.691 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2024-03-24T10:22:46.691 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2024-03-24T10:22:46.691 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T10:22:46.692 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T10:22:46.693 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2024-03-24T10:22:46.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:22:46.811 INFO:teuthology.dispatcher.supervisor:Running job 7619051
2024-03-24T10:22:46.811 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619051 --name pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619051/orig.config.yaml
2024-03-24T10:22:46.814 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619051
2024-03-24T10:22:46.814 INFO:teuthology.dispatcher.supervisor:Job PID: 3724458
2024-03-24T10:22:46.814 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-24T10:24:46.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:26:47.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:28:47.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:30:47.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:32:47.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:34:47.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:36:47.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:38:48.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:40:48.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:42:48.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:44:48.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:46:48.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:48:49.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:50:49.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:52:49.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:54:49.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:56:49.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:58:49.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T10:58:50.035 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1