2024-04-17T15:37:29.640 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T15:37:29.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:37:29.795 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f64b3b08f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f64b4b69c10>, signals=[15])
2024-04-17T15:37:29.795 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging
2024-04-17T15:37:29.796 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T15:37:29.796 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-04-17T15:37:29.827 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging
2024-04-17T15:37:29.827 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T15:37:29.827 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2024-04-17T15:37:29.938 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-17T15:37:29.956 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-17T15:37:29.981 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of rhel 8.6
2024-04-17T15:37:29.997 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6
2024-04-17T15:37:30.307 INFO:teuthology.orchestra.console.smithi077:Power off
2024-04-17T15:37:30.308 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T15:37:30.324 INFO:teuthology.orchestra.console.smithi190:Power off
2024-04-17T15:37:30.325 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T15:37:30.332 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off
2024-04-17T15:37:30.333 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:30.349 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off
2024-04-17T15:37:30.350 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:30.357 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2024-04-17T15:37:30.376 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2024-04-17T15:37:34.362 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:34.377 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:34.472 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2024-04-17T15:37:34.487 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2024-04-17T15:37:38.476 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:38.488 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:38.589 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2024-04-17T15:37:38.598 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2024-04-17T15:37:42.594 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:42.602 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:42.704 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-04-17T15:37:42.710 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2024-04-17T15:37:42.805 INFO:teuthology.orchestra.console.smithi077:Power off completed
2024-04-17T15:37:42.811 INFO:teuthology.orchestra.console.smithi190:Power off completed
2024-04-17T15:37:42.906 INFO:teuthology.orchestra.console.smithi077:Power on
2024-04-17T15:37:42.907 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T15:37:42.914 INFO:teuthology.orchestra.console.smithi190:Power on
2024-04-17T15:37:42.915 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T15:37:42.928 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On
2024-04-17T15:37:42.928 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:42.937 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On
2024-04-17T15:37:42.938 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:42.952 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-04-17T15:37:42.962 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2024-04-17T15:37:46.954 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:46.962 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:47.063 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-04-17T15:37:47.071 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2024-04-17T15:37:47.172 INFO:teuthology.orchestra.console.smithi190:Power on completed
2024-04-17T15:37:47.272 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2024-04-17T15:37:51.066 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T15:37:51.176 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2024-04-17T15:37:51.276 INFO:teuthology.orchestra.console.smithi077:Power on completed
2024-04-17T15:37:51.377 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2024-04-17T15:40:33.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:40:36.254 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:40:37.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:40:40.258 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-04-17T15:40:42.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:40:45.314 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:40:46.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:40:49.310 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-04-17T15:40:51.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:40:54.398 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:40:55.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:40:58.366 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-04-17T15:41:00.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:03.454 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:41:04.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:07.422 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-04-17T15:41:09.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:12.510 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:41:13.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:16.478 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-04-17T15:41:18.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:22.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:36.931 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:41:42.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:46.014 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:41:52.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:41:55.070 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T15:42:01.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:42:01.555 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T15:42:01.556 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T15:42:21.785 INFO:teuthology.provision.fog.smithi190:Node is ready
2024-04-17T15:42:21.785 DEBUG:teuthology.orchestra.run.smithi190:> hostname
2024-04-17T15:42:21.813 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com
2024-04-17T15:42:21.814 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts
2024-04-17T15:42:21.872 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190
2024-04-17T15:42:21.872 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2024-04-17T15:42:21.990 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts
2024-04-17T15:42:22.018 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts
2024-04-17T15:42:22.086 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname
2024-04-17T15:42:22.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2024-04-17T15:42:22.220 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2024-04-17T15:42:22.277 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-17T15:42:22.278 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T15:42:22.279 INFO:teuthology.orchestra.run.smithi190.stdout:
2024-04-17T15:42:22.279 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-17T15:42:22.279 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-17T15:42:22.279 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-17T15:42:22.279 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-17T15:42:22.280 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2024-04-17T15:42:22.281 DEBUG:teuthology.parallel:result is None
2024-04-17T15:42:22.485 WARNING:teuthology.provision.fog.smithi077:timed out
2024-04-17T15:42:28.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:42:28.734 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T15:42:28.735 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T15:42:28.998 INFO:teuthology.provision.fog.smithi077:Node is ready
2024-04-17T15:42:28.998 DEBUG:teuthology.orchestra.run.smithi077:> hostname
2024-04-17T15:42:29.017 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2024-04-17T15:42:29.017 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts
2024-04-17T15:42:29.075 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2024-04-17T15:42:29.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-04-17T15:42:29.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts
2024-04-17T15:42:29.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts
2024-04-17T15:42:29.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname
2024-04-17T15:42:29.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-04-17T15:42:29.437 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-04-17T15:42:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux"
2024-04-17T15:42:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)"
2024-04-17T15:42:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-17T15:42:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-17T15:42:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-17T15:42:29.496 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2024-04-17T15:42:29.497 DEBUG:teuthology.parallel:result is None
2024-04-17T15:42:29.648 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2024-04-17T15:42:29.648 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T15:42:29.681 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com
2024-04-17T15:42:29.681 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T15:42:29.707 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2024-04-17T15:42:29.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-04-17T15:42:29.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:42:29.781 DEBUG:teuthology.orchestra.run.smithi077:> true
2024-04-17T15:42:29.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-04-17T15:42:29.846 DEBUG:teuthology.orchestra.run.smithi077:> uname -m
2024-04-17T15:42:29.902 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2024-04-17T15:42:29.903 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-17T15:42:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/"
2024-04-17T15:42:29.960 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-17T15:42:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T15:42:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:
2024-04-17T15:42:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-17T15:42:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-17T15:42:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-17T15:42:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-17T15:42:29.962 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-04-17T15:42:29.981 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server
2024-04-17T15:42:29.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2024-04-17T15:42:29.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T15:42:30.070 DEBUG:teuthology.orchestra.run.smithi190:> true
2024-04-17T15:42:30.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com'
2024-04-17T15:42:30.144 DEBUG:teuthology.orchestra.run.smithi190:> uname -m
2024-04-17T15:42:30.203 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64
2024-04-17T15:42:30.203 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2024-04-17T15:42:30.264 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/"
2024-04-17T15:42:30.265 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-17T15:42:30.266 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T15:42:30.266 INFO:teuthology.orchestra.run.smithi190.stdout:
2024-04-17T15:42:30.266 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-17T15:42:30.266 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-17T15:42:30.266 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-17T15:42:30.266 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-17T15:42:30.266 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2024-04-17T15:42:30.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:42:30.389 INFO:teuthology.dispatcher.supervisor:Running job 7659685
2024-04-17T15:42:30.389 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi/7659685 --name teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi/7659685/orig.config.yaml
2024-04-17T15:42:30.393 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi/7659685
2024-04-17T15:42:30.394 INFO:teuthology.dispatcher.supervisor:Job PID: 1911246
2024-04-17T15:42:30.394 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T15:44:30.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:46:30.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:48:30.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:50:31.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:52:31.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:54:31.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:56:31.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T15:58:31.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:00:31.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:02:32.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:04:32.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:06:32.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:08:32.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:10:32.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:12:32.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:14:33.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:16:33.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:18:33.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:20:33.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:22:33.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:24:33.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:26:34.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:28:34.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:30:34.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:32:34.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:34:34.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:36:34.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:38:35.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:40:35.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:42:35.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:44:35.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:46:35.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:48:35.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:50:35.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:52:36.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:54:36.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:56:36.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T16:58:36.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:00:36.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:02:36.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:04:37.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:06:37.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:08:37.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:10:37.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:12:37.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:14:37.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:16:38.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:18:38.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:20:38.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:22:38.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:24:38.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:26:38.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:28:39.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:30:39.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:32:39.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:34:39.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:36:39.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:38:39.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:40:40.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:42:40.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:44:40.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:46:40.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:48:40.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:50:40.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:52:41.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:54:41.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:56:41.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T17:58:41.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:00:41.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:02:41.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:04:42.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:06:42.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:08:42.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:10:42.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:12:42.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:14:42.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:16:43.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:18:43.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:20:43.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:22:43.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:24:43.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:26:43.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:28:44.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:30:44.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:32:44.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:34:44.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:36:44.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:38:44.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:40:44.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:42:45.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:44:45.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:46:45.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:48:45.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:50:45.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:52:45.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:54:46.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:56:46.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T18:58:46.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:00:46.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:02:46.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:04:47.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:06:47.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:08:47.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:10:47.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:12:47.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:14:47.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:16:48.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:18:48.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:20:48.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T19:20:48.407 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2024-04-17T19:20:48.521 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660563
2024-04-17T19:20:48.521 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660568