2024-03-14T09:20:13.408 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-14T09:20:13.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:20:13.579 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2275be5f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2276c46c10>, signals=[15])
2024-03-14T09:20:13.579 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2024-03-14T09:20:13.579 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T09:20:13.579 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-03-14T09:20:13.602 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2024-03-14T09:20:13.603 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T09:20:13.603 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-03-14T09:20:13.627 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2024-03-14T09:20:13.628 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T09:20:13.628 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-03-14T09:20:13.721 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-14T09:20:13.732 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-14T09:20:13.770 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-14T09:20:13.775 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.6
2024-03-14T09:20:13.776 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6
2024-03-14T09:20:13.825 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.6
2024-03-14T09:20:14.081 INFO:teuthology.orchestra.console.smithi132:Power off
2024-03-14T09:20:14.081 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T09:20:14.094 INFO:teuthology.orchestra.console.smithi078:Power off
2024-03-14T09:20:14.094 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T09:20:14.109 INFO:teuthology.orchestra.console.smithi152:Power off
2024-03-14T09:20:14.110 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T09:20:14.117 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2024-03-14T09:20:14.117 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:14.126 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2024-03-14T09:20:14.127 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:14.134 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2024-03-14T09:20:14.135 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:14.142 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-03-14T09:20:14.147 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-03-14T09:20:14.156 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-03-14T09:20:14.244 INFO:teuthology.orchestra.console.smithi132:Power off completed
2024-03-14T09:20:14.248 INFO:teuthology.orchestra.console.smithi078:Power off completed
2024-03-14T09:20:14.257 INFO:teuthology.orchestra.console.smithi152:Power off completed
2024-03-14T09:20:14.345 INFO:teuthology.orchestra.console.smithi132:Power on
2024-03-14T09:20:14.346 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T09:20:14.353 INFO:teuthology.orchestra.console.smithi078:Power on
2024-03-14T09:20:14.353 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T09:20:14.361 INFO:teuthology.orchestra.console.smithi152:Power on
2024-03-14T09:20:14.361 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T09:20:14.372 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2024-03-14T09:20:14.372 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:14.380 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On
2024-03-14T09:20:14.380 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:14.389 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2024-03-14T09:20:14.390 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:14.399 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-03-14T09:20:14.413 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-03-14T09:20:14.419 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-03-14T09:20:18.402 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:18.414 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:18.421 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:18.511 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-03-14T09:20:18.523 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-03-14T09:20:18.529 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-03-14T09:20:18.624 INFO:teuthology.orchestra.console.smithi078:Power on completed
2024-03-14T09:20:18.725 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2024-03-14T09:20:22.516 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:22.530 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T09:20:22.626 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2024-03-14T09:20:22.639 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-03-14T09:20:22.727 INFO:teuthology.orchestra.console.smithi132:Power on completed
2024-03-14T09:20:22.740 INFO:teuthology.orchestra.console.smithi152:Power on completed
2024-03-14T09:20:22.828 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2024-03-14T09:20:22.840 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2024-03-14T09:22:53.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:04.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:12.290 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-14T09:23:18.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:21.378 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-14T09:23:23.302 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-14T09:23:24.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:27.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:29.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:30.466 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-14T09:23:32.382 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-14T09:23:36.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:38.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:39.550 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-14T09:23:41.438 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-14T09:23:42.494 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:23:45.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:47.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:48.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:50.494 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-14T09:23:51.550 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:23:56.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:57.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:23:59.550 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-14T09:24:00.610 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:24:05.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:06.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:09.698 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:24:15.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:18.782 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:24:23.966 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-14T09:24:24.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:29.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:33.022 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-14T09:24:39.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:42.431 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T09:24:42.431 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T09:24:43.170 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:24:45.556 WARNING:teuthology.provision.fog.smithi132:timed out
2024-03-14T09:24:49.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:51.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:24:51.776 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T09:24:51.776 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T09:24:52.076 INFO:teuthology.provision.fog.smithi132:Node is ready
2024-03-14T09:24:52.076 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2024-03-14T09:24:52.092 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132
2024-03-14T09:24:52.093 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132 /etc/hosts
2024-03-14T09:24:52.149 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2024-03-14T09:24:52.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-03-14T09:24:52.253 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hosts
2024-03-14T09:24:52.254 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:24:52.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2024-03-14T09:24:52.348 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hostname
2024-03-14T09:24:52.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-03-14T09:24:52.480 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)"
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6"
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-14T09:24:52.537 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-14T09:24:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-14T09:24:52.539 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2024-03-14T09:24:52.540 DEBUG:teuthology.parallel:result is None
2024-03-14T09:24:58.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:25:01.310 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-03-14T09:25:02.744 INFO:teuthology.provision.fog.smithi078:Node is ready
2024-03-14T09:25:02.744 DEBUG:teuthology.orchestra.run.smithi078:> hostname
2024-03-14T09:25:02.805 INFO:teuthology.orchestra.run.smithi078.stdout:smithi045
2024-03-14T09:25:02.806 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi045 /etc/hosts
2024-03-14T09:25:02.865 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-03-14T09:25:02.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi045/smithi078/g' /etc/hostname
2024-03-14T09:25:03.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2024-03-14T09:25:03.038 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-14T09:25:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/"
2024-03-14T09:25:03.100 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-14T09:25:03.100 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T09:25:03.100 INFO:teuthology.orchestra.run.smithi078.stdout:
2024-03-14T09:25:03.100 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T09:25:03.100 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-14T09:25:03.100 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-14T09:25:03.100 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-14T09:25:03.100 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2024-03-14T09:25:03.101 DEBUG:teuthology.parallel:result is None
2024-03-14T09:25:07.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:25:07.756 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T09:25:07.756 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T09:25:23.316 INFO:teuthology.provision.fog.smithi152:Node is ready
2024-03-14T09:25:23.316 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2024-03-14T09:25:23.338 INFO:teuthology.orchestra.run.smithi152.stdout:smithi045
2024-03-14T09:25:23.338 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi045 /etc/hosts
2024-03-14T09:25:23.397 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-03-14T09:25:23.397 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi045/smithi152/g' /etc/hostname
2024-03-14T09:25:23.527 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-03-14T09:25:23.555 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-03-14T09:25:23.614 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux"
2024-03-14T09:25:23.614 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)"
2024-03-14T09:25:23.614 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel"
2024-03-14T09:25:23.614 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora"
2024-03-14T09:25:23.614 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6"
2024-03-14T09:25:23.614 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-14T09:25:23.615 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-14T09:25:23.615 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2024-03-14T09:25:23.616 DEBUG:teuthology.parallel:result is None
2024-03-14T09:25:23.804 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2024-03-14T09:25:23.804 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T09:25:23.834 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2024-03-14T09:25:23.834 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T09:25:23.858 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2024-03-14T09:25:23.858 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T09:25:23.876 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2024-03-14T09:25:23.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-03-14T09:25:23.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:25:23.952 DEBUG:teuthology.orchestra.run.smithi078:> true
2024-03-14T09:25:24.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-03-14T09:25:24.087 DEBUG:teuthology.orchestra.run.smithi078:> uname -m
2024-03-14T09:25:24.144 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2024-03-14T09:25:24.144 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-14T09:25:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T09:25:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:
2024-03-14T09:25:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T09:25:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-14T09:25:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-14T09:25:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-14T09:25:24.202 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-03-14T09:25:24.227 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2024-03-14T09:25:24.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-03-14T09:25:24.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:25:24.298 DEBUG:teuthology.orchestra.run.smithi132:> true
2024-03-14T09:25:24.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-03-14T09:25:24.431 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2024-03-14T09:25:24.489 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2024-03-14T09:25:24.489 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-03-14T09:25:24.545 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T09:25:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:
2024-03-14T09:25:24.547 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T09:25:24.547 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-14T09:25:24.547 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-14T09:25:24.547 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-14T09:25:24.549 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-03-14T09:25:24.575 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2024-03-14T09:25:24.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-03-14T09:25:24.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T09:25:24.650 DEBUG:teuthology.orchestra.run.smithi152:> true
2024-03-14T09:25:24.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-03-14T09:25:24.726 DEBUG:teuthology.orchestra.run.smithi152:> uname -m
2024-03-14T09:25:24.784 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2024-03-14T09:25:24.785 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-03-14T09:25:24.842 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux"
2024-03-14T09:25:24.842 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)"
2024-03-14T09:25:24.842 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-14T09:25:24.843 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-14T09:25:24.844 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-14T09:25:24.844 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-03-14T09:25:24.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:25:24.971 INFO:teuthology.dispatcher.supervisor:Running job 7598679
2024-03-14T09:25:24.971 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-13_19:31:43-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7598679 --name yuriw-2024-03-13_19:31:43-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/yuriw-2024-03-13_19:31:43-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7598679/orig.config.yaml
2024-03-14T09:25:24.974 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-13_19:31:43-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7598679
2024-03-14T09:25:24.974 INFO:teuthology.dispatcher.supervisor:Job PID: 4036906
2024-03-14T09:25:24.975 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-14T09:27:25.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:29:25.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:31:25.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:33:25.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:35:25.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:37:25.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:39:26.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:41:26.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:43:26.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:45:26.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:47:26.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:49:26.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:51:26.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:53:27.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:55:27.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:57:27.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T09:59:27.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T10:01:27.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T10:03:27.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T10:05:28.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T10:07:28.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T10:09:28.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T10:11:28.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T10:11:28.693 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1