2024-04-13T16:34:05.551 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-13T16:34:05.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:34:05.742 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f43b2bc7f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f43b3c28c10>, signals=[15])
2024-04-13T16:34:05.743 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging
2024-04-13T16:34:05.744 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T16:34:05.744 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2024-04-13T16:34:05.762 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging
2024-04-13T16:34:05.763 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T16:34:05.763 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2024-04-13T16:34:05.788 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2024-04-13T16:34:05.788 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T16:34:05.788 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-04-13T16:34:05.879 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-13T16:34:05.907 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-13T16:34:05.919 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-13T16:34:05.927 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.6
2024-04-13T16:34:05.959 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.6
2024-04-13T16:34:05.964 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.6
2024-04-13T16:34:06.267 INFO:teuthology.orchestra.console.smithi060:Power off
2024-04-13T16:34:06.267 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T16:34:06.283 INFO:teuthology.orchestra.console.smithi144:Power off
2024-04-13T16:34:06.283 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T16:34:06.294 INFO:teuthology.orchestra.console.smithi191:Power off
2024-04-13T16:34:06.295 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T16:34:06.302 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off
2024-04-13T16:34:06.303 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:06.310 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off
2024-04-13T16:34:06.310 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:06.319 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-04-13T16:34:06.320 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:06.328 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2024-04-13T16:34:06.333 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off
2024-04-13T16:34:06.341 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-04-13T16:34:06.430 INFO:teuthology.orchestra.console.smithi060:Power off completed
2024-04-13T16:34:06.434 INFO:teuthology.orchestra.console.smithi144:Power off completed
2024-04-13T16:34:06.442 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-04-13T16:34:06.531 INFO:teuthology.orchestra.console.smithi060:Power on
2024-04-13T16:34:06.531 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T16:34:06.539 INFO:teuthology.orchestra.console.smithi144:Power on
2024-04-13T16:34:06.539 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T16:34:06.545 INFO:teuthology.orchestra.console.smithi191:Power on
2024-04-13T16:34:06.546 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T16:34:06.558 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On
2024-04-13T16:34:06.559 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:06.566 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2024-04-13T16:34:06.567 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:06.573 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On
2024-04-13T16:34:06.574 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:06.582 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2024-04-13T16:34:06.589 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-04-13T16:34:06.595 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off
2024-04-13T16:34:10.583 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:10.591 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:10.598 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:10.693 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on
2024-04-13T16:34:10.699 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-04-13T16:34:10.706 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on
2024-04-13T16:34:10.794 INFO:teuthology.orchestra.console.smithi060:Power on completed
2024-04-13T16:34:10.807 INFO:teuthology.orchestra.console.smithi144:Power on completed
2024-04-13T16:34:10.895 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2024-04-13T16:34:10.908 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish
2024-04-13T16:34:14.702 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T16:34:14.811 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-04-13T16:34:14.912 INFO:teuthology.orchestra.console.smithi191:Power on completed
2024-04-13T16:34:15.012 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2024-04-13T16:36:42.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:36:45.122 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-04-13T16:36:51.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:36:54.206 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-04-13T16:36:57.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:00.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:00.222 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2024-04-13T16:37:01.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:03.262 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-04-13T16:37:04.286 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-04-13T16:37:06.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:09.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:09.278 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2024-04-13T16:37:10.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:12.318 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-04-13T16:37:13.342 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-04-13T16:37:15.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:18.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:18.334 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2024-04-13T16:37:19.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:21.374 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-04-13T16:37:22.398 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-04-13T16:37:24.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:27.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:27.390 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2024-04-13T16:37:28.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:30.434 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-04-13T16:37:31.454 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-04-13T16:37:33.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:36.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:36.446 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2024-04-13T16:37:37.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:40.510 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-04-13T16:37:42.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:45.502 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2024-04-13T16:37:46.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:37:51.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:38:36.480 WARNING:teuthology.provision.fog.smithi060:timed out
2024-04-13T16:38:42.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:38:42.790 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T16:38:42.790 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T16:38:43.037 INFO:teuthology.provision.fog.smithi060:Node is ready
2024-04-13T16:38:43.038 DEBUG:teuthology.orchestra.run.smithi060:> hostname
2024-04-13T16:38:43.059 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2024-04-13T16:38:43.059 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts
2024-04-13T16:38:43.120 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2024-04-13T16:38:43.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2024-04-13T16:38:43.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts
2024-04-13T16:38:43.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts
2024-04-13T16:38:43.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname
2024-04-13T16:38:43.423 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2024-04-13T16:38:43.497 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2024-04-13T16:38:43.559 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T16:38:43.559 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T16:38:43.559 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel"
2024-04-13T16:38:43.559 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora"
2024-04-13T16:38:43.559 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6"
2024-04-13T16:38:43.559 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2024-04-13T16:38:43.559 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T16:38:43.560 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T16:38:43.561 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2024-04-13T16:38:43.563 DEBUG:teuthology.parallel:result is None
2024-04-13T16:38:46.517 WARNING:teuthology.provision.fog.smithi191:timed out
2024-04-13T16:38:51.512 WARNING:teuthology.provision.fog.smithi144:timed out
2024-04-13T16:38:52.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:38:52.762 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T16:38:52.763 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T16:38:53.027 INFO:teuthology.provision.fog.smithi191:Node is ready
2024-04-13T16:38:53.028 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2024-04-13T16:38:53.085 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191
2024-04-13T16:38:53.085 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191 /etc/hosts
2024-04-13T16:38:53.143 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2024-04-13T16:38:53.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-04-13T16:38:53.251 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hosts
2024-04-13T16:38:53.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2024-04-13T16:38:53.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hostname
2024-04-13T16:38:53.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-04-13T16:38:53.481 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T16:38:53.538 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T16:38:53.539 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T16:38:53.539 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T16:38:53.539 INFO:teuthology.orchestra.run.smithi191.stdout:
2024-04-13T16:38:53.539 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T16:38:53.539 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T16:38:53.539 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T16:38:53.539 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T16:38:53.539 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2024-04-13T16:38:53.540 DEBUG:teuthology.parallel:result is None
2024-04-13T16:38:57.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:38:57.766 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T16:38:57.766 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T16:38:58.028 INFO:teuthology.provision.fog.smithi144:Node is ready
2024-04-13T16:38:58.028 DEBUG:teuthology.orchestra.run.smithi144:> hostname
2024-04-13T16:38:58.045 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com
2024-04-13T16:38:58.046 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts
2024-04-13T16:38:58.103 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144
2024-04-13T16:38:58.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2024-04-13T16:38:58.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts
2024-04-13T16:38:58.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts
2024-04-13T16:38:58.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname
2024-04-13T16:38:58.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2024-04-13T16:38:58.433 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2024-04-13T16:38:58.489 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T16:38:58.489 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T16:38:58.490 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T16:38:58.491 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T16:38:58.491 INFO:teuthology.provision.fog.smithi144:Deploy complete!
2024-04-13T16:38:58.491 DEBUG:teuthology.parallel:result is None
2024-04-13T16:38:58.680 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2024-04-13T16:38:58.681 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-13T16:38:58.706 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com
2024-04-13T16:38:58.707 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-13T16:38:58.723 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2024-04-13T16:38:58.723 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-13T16:38:58.741 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2024-04-13T16:38:58.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2024-04-13T16:38:58.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:38:58.819 DEBUG:teuthology.orchestra.run.smithi060:> true
2024-04-13T16:38:58.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com'
2024-04-13T16:38:58.962 DEBUG:teuthology.orchestra.run.smithi060:> uname -m
2024-04-13T16:38:59.023 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2024-04-13T16:38:59.023 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2024-04-13T16:38:59.084 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:
2024-04-13T16:38:59.085 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T16:38:59.086 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T16:38:59.086 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T16:38:59.086 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T16:38:59.086 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2024-04-13T16:38:59.106 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server
2024-04-13T16:38:59.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com'
2024-04-13T16:38:59.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:38:59.177 DEBUG:teuthology.orchestra.run.smithi144:> true
2024-04-13T16:38:59.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com'
2024-04-13T16:38:59.244 DEBUG:teuthology.orchestra.run.smithi144:> uname -m
2024-04-13T16:38:59.300 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64
2024-04-13T16:38:59.301 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel"
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora"
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6"
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8"
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T16:38:59.357 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31"
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T16:38:59.358 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T16:38:59.358 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2024-04-13T16:38:59.381 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2024-04-13T16:38:59.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-04-13T16:38:59.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T16:38:59.455 DEBUG:teuthology.orchestra.run.smithi191:> true
2024-04-13T16:38:59.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-04-13T16:38:59.531 DEBUG:teuthology.orchestra.run.smithi191:> uname -m
2024-04-13T16:38:59.590 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2024-04-13T16:38:59.590 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-04-13T16:38:59.649 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T16:38:59.650 INFO:teuthology.orchestra.run.smithi191.stdout:
2024-04-13T16:38:59.651 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T16:38:59.651 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T16:38:59.651 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T16:38:59.651 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T16:38:59.651 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-04-13T16:38:59.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:38:59.782 INFO:teuthology.dispatcher.supervisor:Running job 7651421
2024-04-13T16:38:59.782 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651421 --name teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651421/orig.config.yaml
2024-04-13T16:38:59.785 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651421
2024-04-13T16:38:59.786 INFO:teuthology.dispatcher.supervisor:Job PID: 1116651
2024-04-13T16:38:59.786 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-13T16:40:59.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:43:00.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:45:00.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:47:00.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:49:00.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:51:00.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:53:00.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T16:53:00.906 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1