2024-04-13T18:06:54.285 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-13T18:06:54.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:06:54.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fea7ae33f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fea7be94c10>, signals=[15])
2024-04-13T18:06:54.507 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2024-04-13T18:06:54.508 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:06:54.508 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-04-13T18:06:54.531 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging
2024-04-13T18:06:54.531 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:06:54.531 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-04-13T18:06:54.555 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-04-13T18:06:54.556 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:06:54.556 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-04-13T18:06:54.644 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-13T18:06:54.665 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-13T18:06:54.675 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-13T18:06:54.689 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.6
2024-04-13T18:06:54.707 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.6
2024-04-13T18:06:54.733 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6
2024-04-13T18:06:54.904 INFO:teuthology.orchestra.console.smithi117:Power off
2024-04-13T18:06:54.904 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:06:54.919 INFO:teuthology.orchestra.console.smithi104:Power off
2024-04-13T18:06:54.920 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:06:54.931 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off
2024-04-13T18:06:54.931 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:54.941 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2024-04-13T18:06:54.941 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:54.954 INFO:teuthology.orchestra.console.smithi119:Power off
2024-04-13T18:06:54.954 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:06:54.961 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-13T18:06:54.961 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-13T18:06:54.973 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-04-13T18:06:54.973 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:54.994 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-04-13T18:06:55.062 INFO:teuthology.orchestra.console.smithi117:Power off completed
2024-04-13T18:06:55.063 INFO:teuthology.orchestra.console.smithi104:Power off completed
2024-04-13T18:06:55.096 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-04-13T18:06:55.163 INFO:teuthology.orchestra.console.smithi117:Power on
2024-04-13T18:06:55.163 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:06:55.172 INFO:teuthology.orchestra.console.smithi104:Power on
2024-04-13T18:06:55.173 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:06:55.189 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On
2024-04-13T18:06:55.189 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:55.200 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2024-04-13T18:06:55.200 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:55.208 INFO:teuthology.orchestra.console.smithi119:Power on
2024-04-13T18:06:55.208 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:06:55.220 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-13T18:06:55.227 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-13T18:06:55.229 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-04-13T18:06:55.229 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:55.253 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-04-13T18:06:59.222 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:59.230 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:59.255 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:06:59.333 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-13T18:06:59.349 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-13T18:06:59.369 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-04-13T18:06:59.470 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-04-13T18:06:59.571 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-04-13T18:07:03.338 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:07:03.350 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:07:03.451 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2024-04-13T18:07:03.465 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-04-13T18:07:03.553 INFO:teuthology.orchestra.console.smithi117:Power on completed
2024-04-13T18:07:03.566 INFO:teuthology.orchestra.console.smithi104:Power on completed
2024-04-13T18:07:03.654 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2024-04-13T18:07:03.667 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2024-04-13T18:09:35.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:09:35.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:09:35.209 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:09:35.369 ERROR:teuthology.orchestra.connection:Error authenticating with smithi117.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:09:46.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:09:49.246 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-04-13T18:09:55.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:09:58.305 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-04-13T18:10:04.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:10:07.362 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-04-13T18:10:13.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:10:16.414 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-04-13T18:10:22.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:10:25.470 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-04-13T18:10:31.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:10:34.526 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-04-13T18:10:39.212 WARNING:teuthology.provision.fog.smithi104:timed out
2024-04-13T18:10:39.371 WARNING:teuthology.provision.fog.smithi117:timed out
2024-04-13T18:10:40.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:10:45.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:10:45.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:03.582 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-13T18:11:03.838 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-13T18:11:09.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:09.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:12.638 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-13T18:11:12.897 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-13T18:11:18.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:18.892 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:11:18.893 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:11:18.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:19.143 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:11:19.144 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:11:39.278 INFO:teuthology.provision.fog.smithi104:Node is ready
2024-04-13T18:11:39.278 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2024-04-13T18:11:39.301 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104
2024-04-13T18:11:39.301 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104 /etc/hosts
2024-04-13T18:11:39.360 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2024-04-13T18:11:39.360 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-04-13T18:11:39.390 INFO:teuthology.provision.fog.smithi117:Node is ready
2024-04-13T18:11:39.391 DEBUG:teuthology.orchestra.run.smithi117:> hostname
2024-04-13T18:11:39.412 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2024-04-13T18:11:39.413 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts
2024-04-13T18:11:39.472 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2024-04-13T18:11:39.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-04-13T18:11:39.488 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104/smithi104/g' /etc/hosts
2024-04-13T18:11:39.517 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2024-04-13T18:11:39.587 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104/smithi104/g' /etc/hostname
2024-04-13T18:11:39.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts
2024-04-13T18:11:39.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts
2024-04-13T18:11:39.655 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-04-13T18:11:39.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname
2024-04-13T18:11:39.722 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-04-13T18:11:39.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-04-13T18:11:39.778 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T18:11:39.778 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:11:39.779 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T18:11:39.780 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T18:11:39.780 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T18:11:39.780 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2024-04-13T18:11:39.782 DEBUG:teuthology.parallel:result is None
2024-04-13T18:11:39.828 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-04-13T18:11:39.885 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:11:39.886 INFO:teuthology.orchestra.run.smithi117.stdout:
2024-04-13T18:11:39.887 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:11:39.887 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T18:11:39.887 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T18:11:39.887 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T18:11:39.887 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2024-04-13T18:11:39.887 DEBUG:teuthology.parallel:result is None
2024-04-13T18:11:40.531 WARNING:teuthology.provision.fog.smithi119:timed out
2024-04-13T18:11:46.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:46.748 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:11:46.749 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:11:46.990 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-04-13T18:11:46.991 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-04-13T18:11:47.008 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119
2024-04-13T18:11:47.008 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119 /etc/hosts
2024-04-13T18:11:47.067 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-04-13T18:11:47.067 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-04-13T18:11:47.179 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hosts
2024-04-13T18:11:47.208 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-04-13T18:11:47.276 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hostname
2024-04-13T18:11:47.343 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-04-13T18:11:47.410 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-04-13T18:11:47.467 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T18:11:47.468 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T18:11:47.468 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-04-13T18:11:47.469 DEBUG:teuthology.parallel:result is None
2024-04-13T18:11:47.659 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2024-04-13T18:11:47.659 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-13T18:11:47.757 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2024-04-13T18:11:47.758 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-13T18:11:47.833 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-04-13T18:11:47.833 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-13T18:11:47.853 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2024-04-13T18:11:47.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-04-13T18:11:47.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:47.926 DEBUG:teuthology.orchestra.run.smithi104:> true
2024-04-13T18:11:47.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-04-13T18:11:47.997 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2024-04-13T18:11:48.059 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2024-04-13T18:11:48.060 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-04-13T18:11:48.121 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T18:11:48.121 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:11:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T18:11:48.123 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T18:11:48.123 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T18:11:48.123 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-04-13T18:11:48.151 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2024-04-13T18:11:48.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-04-13T18:11:48.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:48.225 DEBUG:teuthology.orchestra.run.smithi117:> true
2024-04-13T18:11:48.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-04-13T18:11:48.254 DEBUG:teuthology.orchestra.run.smithi117:> uname -m
2024-04-13T18:11:48.316 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2024-04-13T18:11:48.317 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-04-13T18:11:48.378 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T18:11:48.379 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T18:11:48.380 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T18:11:48.380 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-04-13T18:11:48.402 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-04-13T18:11:48.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-04-13T18:11:48.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:11:48.474 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-04-13T18:11:48.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-04-13T18:11:48.541 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-04-13T18:11:48.599 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-04-13T18:11:48.600 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-04-13T18:11:48.658 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T18:11:48.658 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T18:11:48.658 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-04-13T18:11:48.658 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T18:11:48.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T18:11:48.661 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-04-13T18:11:48.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:11:48.786 INFO:teuthology.dispatcher.supervisor:Running job 7651553
2024-04-13T18:11:48.787 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651553 --name teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/direct_io}} -- /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651553/orig.config.yaml
2024-04-13T18:11:48.790 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651553
2024-04-13T18:11:48.790 INFO:teuthology.dispatcher.supervisor:Job PID: 1714140
2024-04-13T18:11:48.790 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-13T18:13:48.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:15:48.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:17:48.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:19:49.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:21:49.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:23:49.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:25:49.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:27:49.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:29:49.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:31:49.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:31:49.631 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1