2023-11-23T15:05:03.439 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T15:05:03.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:05:03.577 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8e524a4940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8e52f98670>, signals=[15])
2023-11-23T15:05:03.578 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging
2023-11-23T15:05:03.578 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T15:05:03.578 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-11-23T15:05:03.616 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2023-11-23T15:05:03.616 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T15:05:03.616 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2023-11-23T15:05:03.734 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-23T15:05:03.743 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-23T15:05:03.779 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of rhel 8.6
2023-11-23T15:05:03.790 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.6
2023-11-23T15:05:04.013 INFO:teuthology.orchestra.console.smithi094:Power off
2023-11-23T15:05:04.013 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T15:05:04.025 INFO:teuthology.orchestra.console.smithi192:Power off
2023-11-23T15:05:04.025 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T15:05:04.034 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-11-23T15:05:04.035 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T15:05:04.044 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2023-11-23T15:05:04.045 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T15:05:04.054 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-23T15:05:04.064 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-11-23T15:05:04.155 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-11-23T15:05:04.165 INFO:teuthology.orchestra.console.smithi192:Power off completed
2023-11-23T15:05:04.256 INFO:teuthology.orchestra.console.smithi094:Power on
2023-11-23T15:05:04.256 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T15:05:04.265 INFO:teuthology.orchestra.console.smithi192:Power on
2023-11-23T15:05:04.266 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T15:05:04.277 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On
2023-11-23T15:05:04.278 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T15:05:04.285 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2023-11-23T15:05:04.286 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T15:05:04.298 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-23T15:05:04.305 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-11-23T15:05:08.303 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T15:05:08.309 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T15:05:08.411 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-23T15:05:08.416 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-11-23T15:05:08.516 INFO:teuthology.orchestra.console.smithi192:Power on completed
2023-11-23T15:05:08.617 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2023-11-23T15:05:12.416 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T15:05:12.540 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-11-23T15:05:12.641 INFO:teuthology.orchestra.console.smithi094:Power on completed
2023-11-23T15:05:12.741 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish
2023-11-23T15:07:54.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:07:58.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:13.026 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-23T15:08:17.126 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-23T15:08:19.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:22.117 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-23T15:08:23.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:26.210 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-23T15:08:28.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:31.202 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-23T15:08:32.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:35.266 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-23T15:08:37.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:40.259 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-23T15:08:41.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:44.322 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-23T15:08:46.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:49.314 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-23T15:08:50.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:08:55.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:09:22.244 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T15:09:22.245 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T15:09:22.611 INFO:teuthology.provision.fog.smithi094:Node is ready
2023-11-23T15:09:22.612 DEBUG:teuthology.orchestra.run.smithi094:> hostname
2023-11-23T15:09:22.633 INFO:teuthology.orchestra.run.smithi094.stdout:smithi022
2023-11-23T15:09:22.633 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi022 /etc/hosts
2023-11-23T15:09:22.689 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-11-23T15:09:22.690 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi022/smithi094/g' /etc/hostname
2023-11-23T15:09:22.892 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2023-11-23T15:09:22.918 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-11-23T15:09:22.974 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:
2023-11-23T15:09:22.975 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T15:09:22.976 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T15:09:22.976 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T15:09:22.976 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T15:09:22.976 INFO:teuthology.provision.fog.smithi094:Deploy complete!
2023-11-23T15:09:22.977 DEBUG:teuthology.parallel:result is None
2023-11-23T15:09:55.354 WARNING:teuthology.provision.fog.smithi192:timed out
2023-11-23T15:10:01.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:10:01.587 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T15:10:01.587 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T15:10:01.850 INFO:teuthology.provision.fog.smithi192:Node is ready
2023-11-23T15:10:01.851 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2023-11-23T15:10:01.907 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2023-11-23T15:10:01.907 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2023-11-23T15:10:01.964 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2023-11-23T15:10:01.965 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2023-11-23T15:10:02.075 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2023-11-23T15:10:02.103 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2023-11-23T15:10:02.172 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2023-11-23T15:10:02.239 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2023-11-23T15:10:02.305 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2023-11-23T15:10:02.361 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T15:10:02.361 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T15:10:02.361 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel"
2023-11-23T15:10:02.361 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora"
2023-11-23T15:10:02.361 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T15:10:02.362 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T15:10:02.363 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2023-11-23T15:10:02.363 DEBUG:teuthology.parallel:result is None
2023-11-23T15:10:02.508 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com
2023-11-23T15:10:02.509 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T15:10:02.537 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2023-11-23T15:10:02.537 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T15:10:02.555 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server
2023-11-23T15:10:02.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-11-23T15:10:02.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:10:02.622 DEBUG:teuthology.orchestra.run.smithi094:> true
2023-11-23T15:10:02.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-11-23T15:10:02.751 DEBUG:teuthology.orchestra.run.smithi094:> uname -m
2023-11-23T15:10:02.807 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64
2023-11-23T15:10:02.808 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-11-23T15:10:02.864 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T15:10:02.864 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T15:10:02.865 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T15:10:02.866 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T15:10:02.866 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T15:10:02.866 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-11-23T15:10:02.888 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2023-11-23T15:10:02.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2023-11-23T15:10:02.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T15:10:02.953 DEBUG:teuthology.orchestra.run.smithi192:> true
2023-11-23T15:10:03.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2023-11-23T15:10:03.019 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2023-11-23T15:10:03.075 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2023-11-23T15:10:03.075 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2023-11-23T15:10:03.131 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T15:10:03.131 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T15:10:03.131 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T15:10:03.132 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T15:10:03.133 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2023-11-23T15:10:03.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:10:03.235 INFO:teuthology.dispatcher.supervisor:Running job 7464823
2023-11-23T15:10:03.235 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-23_15:03:35-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464823 --name mchangir-2023-11-23_15:03:35-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-11-23_15:03:35-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464823/orig.config.yaml
2023-11-23T15:10:03.237 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-23_15:03:35-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464823
2023-11-23T15:10:03.238 INFO:teuthology.dispatcher.supervisor:Job PID: 3416947
2023-11-23T15:10:03.238 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-23T15:12:03.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:14:03.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:16:03.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:18:03.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:20:03.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:22:04.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:24:04.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:26:04.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:28:04.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:30:04.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:32:05.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:34:05.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:36:05.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:38:05.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:40:05.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:42:05.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:44:05.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:46:05.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:48:06.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:50:06.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:52:06.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:54:06.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:56:06.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T15:58:06.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:00:07.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:02:07.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:04:07.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:06:07.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:08:07.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:10:07.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:12:08.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:14:08.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:16:08.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:18:08.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:20:08.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:22:08.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:24:09.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:26:09.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:28:09.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:30:09.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:32:09.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:34:09.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:36:10.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:38:10.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:40:10.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:42:10.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:44:10.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:46:10.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:48:11.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:50:11.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:52:11.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:54:11.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:56:11.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T16:58:11.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T17:00:12.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T17:02:12.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T17:02:12.311 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-23T17:02:12.484 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-23T17:02:12.484 INFO:teuthology.nuke:Checking targets against current locks
2023-11-23T17:02:12.536 DEBUG:teuthology.nuke:shortname: smithi094
2023-11-23T17:02:12.536 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T17:02:12.557 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-23_15:03:35-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464823', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 15:05:02.659938', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-23T17:02:12.561 DEBUG:teuthology.nuke:shortname: smithi192
2023-11-23T17:02:12.561 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T17:02:12.587 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-23_15:03:35-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464823', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 15:05:02.661446', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-23T17:02:12.615 INFO:teuthology.orchestra.console.smithi094:Power off
2023-11-23T17:02:12.615 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T17:02:12.638 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-11-23T17:02:12.639 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T17:02:12.657 INFO:teuthology.orchestra.console.smithi192:Power off
2023-11-23T17:02:12.658 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T17:02:12.666 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-23T17:02:12.679 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2023-11-23T17:02:12.679 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T17:02:12.699 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-11-23T17:02:12.768 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-11-23T17:02:12.801 INFO:teuthology.orchestra.console.smithi192:Power off completed
2023-11-23T17:02:12.920 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com
2023-11-23T17:02:12.942 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com