2024-04-01T08:19:25.814 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-01T08:19:25.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:19:25.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5f18a4ff70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5f19ab0c10>, signals=[15])
2024-04-01T08:19:25.992 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2024-04-01T08:19:25.992 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T08:19:25.992 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-04-01T08:19:26.011 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2024-04-01T08:19:26.011 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T08:19:26.011 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-04-01T08:19:26.027 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2024-04-01T08:19:26.027 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T08:19:26.027 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-04-01T08:19:26.130 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T08:19:26.142 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T08:19:26.151 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T08:19:26.174 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream
2024-04-01T08:19:26.185 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream
2024-04-01T08:19:26.203 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream
2024-04-01T08:19:26.415 INFO:teuthology.orchestra.console.smithi028:Power off
2024-04-01T08:19:26.415 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T08:19:26.428 INFO:teuthology.orchestra.console.smithi111:Power off
2024-04-01T08:19:26.429 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T08:19:26.442 INFO:teuthology.orchestra.console.smithi026:Power off
2024-04-01T08:19:26.442 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T08:19:26.449 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2024-04-01T08:19:26.449 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:26.457 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2024-04-01T08:19:26.457 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:26.466 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-04-01T08:19:26.466 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:26.474 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-04-01T08:19:26.486 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-04-01T08:19:26.488 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-04-01T08:19:26.575 INFO:teuthology.orchestra.console.smithi111:Power off completed
2024-04-01T08:19:26.587 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-04-01T08:19:26.588 INFO:teuthology.orchestra.console.smithi028:Power off completed
2024-04-01T08:19:26.677 INFO:teuthology.orchestra.console.smithi111:Power on
2024-04-01T08:19:26.677 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T08:19:26.688 INFO:teuthology.orchestra.console.smithi026:Power on
2024-04-01T08:19:26.688 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T08:19:26.695 INFO:teuthology.orchestra.console.smithi028:Power on
2024-04-01T08:19:26.695 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T08:19:26.703 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2024-04-01T08:19:26.703 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:26.712 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2024-04-01T08:19:26.712 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:26.721 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2024-04-01T08:19:26.721 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:26.729 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-04-01T08:19:26.733 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-04-01T08:19:26.742 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-04-01T08:19:30.732 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:30.740 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:30.747 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:30.842 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-04-01T08:19:30.849 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-04-01T08:19:30.855 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-04-01T08:19:30.955 INFO:teuthology.orchestra.console.smithi028:Power on completed
2024-04-01T08:19:31.056 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2024-04-01T08:19:34.847 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:34.854 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T08:19:34.957 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-04-01T08:19:34.964 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-04-01T08:19:35.058 INFO:teuthology.orchestra.console.smithi111:Power on completed
2024-04-01T08:19:35.065 INFO:teuthology.orchestra.console.smithi026:Power on completed
2024-04-01T08:19:35.159 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2024-04-01T08:19:35.166 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2024-04-01T08:21:47.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:21:47.166 ERROR:teuthology.orchestra.connection:Error authenticating with smithi028.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-01T08:21:51.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:21:54.206 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-01T08:22:00.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:22:03.266 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-01T08:22:09.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:22:12.354 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-01T08:22:18.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:22:21.410 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-01T08:22:25.822 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-04-01T08:22:27.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:22:30.498 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-01T08:22:31.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:22:34.878 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-04-01T08:22:36.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:22:40.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:06.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:09.538 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-04-01T08:23:15.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:18.594 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-04-01T08:23:24.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:27.646 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-04-01T08:23:33.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:36.502 WARNING:teuthology.provision.fog.smithi026:timed out
2024-04-01T08:23:36.702 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-04-01T08:23:40.881 WARNING:teuthology.provision.fog.smithi028:timed out
2024-04-01T08:23:42.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:42.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:42.783 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T08:23:42.783 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T08:23:43.106 INFO:teuthology.provision.fog.smithi026:Node is ready
2024-04-01T08:23:43.107 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2024-04-01T08:23:43.122 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2024-04-01T08:23:43.122 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2024-04-01T08:23:43.177 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2024-04-01T08:23:43.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-04-01T08:23:43.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2024-04-01T08:23:43.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2024-04-01T08:23:43.400 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2024-04-01T08:23:43.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-04-01T08:23:43.543 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-04-01T08:23:43.598 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-04-01T08:23:43.598 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T08:23:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T08:23:43.600 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2024-04-01T08:23:43.602 DEBUG:teuthology.parallel:result is None
2024-04-01T08:23:45.759 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-04-01T08:23:46.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:47.192 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T08:23:47.192 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T08:23:47.497 INFO:teuthology.provision.fog.smithi028:Node is ready
2024-04-01T08:23:47.497 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2024-04-01T08:23:47.512 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2024-04-01T08:23:47.512 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2024-04-01T08:23:47.567 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2024-04-01T08:23:47.568 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-04-01T08:23:47.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2024-04-01T08:23:47.701 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2024-04-01T08:23:47.773 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2024-04-01T08:23:47.845 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-04-01T08:23:47.914 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-04-01T08:23:47.970 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-04-01T08:23:47.970 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-04-01T08:23:47.970 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-04-01T08:23:47.970 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-04-01T08:23:47.970 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-04-01T08:23:47.970 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T08:23:47.971 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T08:23:47.971 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2024-04-01T08:23:47.972 DEBUG:teuthology.parallel:result is None
2024-04-01T08:23:51.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:23:54.814 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-04-01T08:24:00.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:24:03.870 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-04-01T08:24:09.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:25:09.874 WARNING:teuthology.provision.fog.smithi111:timed out
2024-04-01T08:25:15.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:25:16.133 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T08:25:16.134 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T08:25:16.486 INFO:teuthology.provision.fog.smithi111:Node is ready
2024-04-01T08:25:16.486 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2024-04-01T08:25:16.501 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2024-04-01T08:25:16.501 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2024-04-01T08:25:16.556 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2024-04-01T08:25:16.556 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-04-01T08:25:16.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2024-04-01T08:25:16.676 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2024-04-01T08:25:16.743 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2024-04-01T08:25:16.810 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-04-01T08:25:16.877 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-04-01T08:25:16.932 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-04-01T08:25:16.932 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-04-01T08:25:16.932 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-04-01T08:25:16.932 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T08:25:16.933 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T08:25:16.933 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2024-04-01T08:25:16.934 DEBUG:teuthology.parallel:result is None
2024-04-01T08:25:17.165 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2024-04-01T08:25:17.166 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T08:25:17.185 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2024-04-01T08:25:17.185 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T08:25:17.202 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2024-04-01T08:25:17.202 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T08:25:17.220 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2024-04-01T08:25:17.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-04-01T08:25:17.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:25:17.324 DEBUG:teuthology.orchestra.run.smithi026:> true
2024-04-01T08:25:17.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-04-01T08:25:17.510 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2024-04-01T08:25:17.564 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2024-04-01T08:25:17.565 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-04-01T08:25:17.619 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-04-01T08:25:17.619 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-04-01T08:25:17.619 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-04-01T08:25:17.619 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-04-01T08:25:17.619 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-04-01T08:25:17.619 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-04-01T08:25:17.619 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T08:25:17.620 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-04-01T08:25:17.620 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-04-01T08:25:17.620 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T08:25:17.620 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-04-01T08:25:17.620 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T08:25:17.620 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T08:25:17.620 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T08:25:17.621 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-04-01T08:25:17.644 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2024-04-01T08:25:17.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-04-01T08:25:17.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:25:17.749 DEBUG:teuthology.orchestra.run.smithi028:> true
2024-04-01T08:25:17.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-04-01T08:25:17.932 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2024-04-01T08:25:17.987 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2024-04-01T08:25:17.988 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-04-01T08:25:18.042 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T08:25:18.043 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-04-01T08:25:18.044 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T08:25:18.044 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T08:25:18.044 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T08:25:18.044 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-04-01T08:25:18.069 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2024-04-01T08:25:18.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-04-01T08:25:18.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T08:25:18.157 DEBUG:teuthology.orchestra.run.smithi111:> true
2024-04-01T08:25:18.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-04-01T08:25:18.226 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2024-04-01T08:25:18.283 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2024-04-01T08:25:18.283 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-04-01T08:25:18.339 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-04-01T08:25:18.339 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-04-01T08:25:18.339 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-04-01T08:25:18.339 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-04-01T08:25:18.339 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T08:25:18.340 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T08:25:18.341 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-04-01T08:25:18.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:25:18.462 INFO:teuthology.dispatcher.supervisor:Running job 7632153
2024-04-01T08:25:18.462 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632153 --name pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/pjd}} -- /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632153/orig.config.yaml
2024-04-01T08:25:18.465 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632153
2024-04-01T08:25:18.465 INFO:teuthology.dispatcher.supervisor:Job PID: 1295674
2024-04-01T08:25:18.465 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-01T08:27:18.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:29:18.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:31:18.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:33:18.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:35:18.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:37:18.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:39:18.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:41:19.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T08:41:19.096 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1