2024-01-20T07:52:06.291 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-20T07:52:06.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T07:52:06.434 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1d39882f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1d3a7e8c10>, signals=[15])
2024-01-20T07:52:06.434 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-01-20T07:52:06.434 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-01-20T07:52:06.434 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-01-20T07:52:06.457 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2024-01-20T07:52:06.457 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2024-01-20T07:52:06.457 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2024-01-20T07:52:06.580 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_9.stream (ID 10)
2024-01-20T07:52:06.594 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10)
2024-01-20T07:52:06.633 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream
2024-01-20T07:52:06.637 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 9.stream
2024-01-20T07:52:06.847 INFO:teuthology.orchestra.console.smithi110:Power off
2024-01-20T07:52:06.847 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T07:52:06.863 INFO:teuthology.orchestra.console.smithi100:Power off
2024-01-20T07:52:06.863 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T07:52:06.873 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2024-01-20T07:52:06.873 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:06.886 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-01-20T07:52:06.886 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:06.894 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2024-01-20T07:52:06.909 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-01-20T07:52:10.897 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:10.909 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:11.005 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2024-01-20T07:52:11.018 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-01-20T07:52:15.008 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:15.019 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:15.117 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2024-01-20T07:52:15.125 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-01-20T07:52:15.218 INFO:teuthology.orchestra.console.smithi110:Power off completed
2024-01-20T07:52:15.226 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-01-20T07:52:15.319 INFO:teuthology.orchestra.console.smithi110:Power on
2024-01-20T07:52:15.319 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-20T07:52:15.327 INFO:teuthology.orchestra.console.smithi100:Power on
2024-01-20T07:52:15.328 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-20T07:52:15.340 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On
2024-01-20T07:52:15.340 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:15.348 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-01-20T07:52:15.348 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:15.359 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2024-01-20T07:52:15.368 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-01-20T07:52:19.365 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:19.371 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:19.473 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2024-01-20T07:52:19.479 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-01-20T07:52:23.479 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:23.485 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T07:52:23.587 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2024-01-20T07:52:23.593 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-01-20T07:52:23.689 INFO:teuthology.orchestra.console.smithi110:Power on completed
2024-01-20T07:52:23.694 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-01-20T07:52:23.790 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2024-01-20T07:52:23.795 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-01-20T07:54:54.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:54:54.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:13.084 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2024-01-20T07:55:13.085 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-20T07:55:19.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:19.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:22.140 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2024-01-20T07:55:22.140 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-20T07:55:28.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:28.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:31.232 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2024-01-20T07:55:31.232 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-20T07:55:37.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:37.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:40.316 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2024-01-20T07:55:40.316 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-20T07:55:46.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:46.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:49.372 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2024-01-20T07:55:49.373 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-20T07:55:55.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:55:55.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:56:55.440 WARNING:teuthology.provision.fog.smithi110:timed out
2024-01-20T07:56:55.441 WARNING:teuthology.provision.fog.smithi100:timed out
2024-01-20T07:57:01.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:57:01.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:57:01.712 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-20T07:57:01.712 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-20T07:57:01.767 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-20T07:57:01.767 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-20T07:57:02.044 INFO:teuthology.provision.fog.smithi110:Node is ready
2024-01-20T07:57:02.044 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2024-01-20T07:57:02.059 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2024-01-20T07:57:02.059 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2024-01-20T07:57:02.113 INFO:teuthology.provision.fog.smithi100:Node is ready
2024-01-20T07:57:02.113 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2024-01-20T07:57:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2024-01-20T07:57:02.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2024-01-20T07:57:02.128 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2024-01-20T07:57:02.128 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts
2024-01-20T07:57:02.184 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2024-01-20T07:57:02.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-01-20T07:57:02.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2024-01-20T07:57:02.268 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2024-01-20T07:57:02.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts
2024-01-20T07:57:02.322 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2024-01-20T07:57:02.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2024-01-20T07:57:02.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname
2024-01-20T07:57:02.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2024-01-20T07:57:02.457 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-01-20T07:57:02.468 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2024-01-20T07:57:02.522 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2024-01-20T07:57:02.522 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2024-01-20T07:57:02.522 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2024-01-20T07:57:02.522 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T07:57:02.523 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T07:57:02.524 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2024-01-20T07:57:02.525 DEBUG:teuthology.parallel:result is None
2024-01-20T07:57:02.526 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-01-20T07:57:02.581 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-01-20T07:57:02.581 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-01-20T07:57:02.581 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-01-20T07:57:02.581 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-01-20T07:57:02.581 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-01-20T07:57:02.581 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-01-20T07:57:02.581 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T07:57:02.582 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-01-20T07:57:02.582 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-01-20T07:57:02.582 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T07:57:02.582 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-01-20T07:57:02.582 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T07:57:02.582 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T07:57:02.582 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T07:57:02.582 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2024-01-20T07:57:02.583 DEBUG:teuthology.parallel:result is None
2024-01-20T07:57:02.764 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2024-01-20T07:57:02.765 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-20T07:57:02.788 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2024-01-20T07:57:02.788 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-20T07:57:02.806 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2024-01-20T07:57:02.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-01-20T07:57:02.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:57:02.896 DEBUG:teuthology.orchestra.run.smithi100:> true
2024-01-20T07:57:02.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-01-20T07:57:02.961 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2024-01-20T07:57:03.016 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2024-01-20T07:57:03.016 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-01-20T07:57:03.069 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T07:57:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T07:57:03.071 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T07:57:03.071 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-01-20T07:57:03.097 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2024-01-20T07:57:03.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2024-01-20T07:57:03.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-20T07:57:03.185 DEBUG:teuthology.orchestra.run.smithi110:> true
2024-01-20T07:57:03.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com'
2024-01-20T07:57:03.210 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2024-01-20T07:57:03.265 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2024-01-20T07:57:03.265 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2024-01-20T07:57:03.320 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2024-01-20T07:57:03.320 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2024-01-20T07:57:03.320 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2024-01-20T07:57:03.320 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2024-01-20T07:57:03.320 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2024-01-20T07:57:03.320 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2024-01-20T07:57:03.320 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-20T07:57:03.321 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2024-01-20T07:57:03.321 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2024-01-20T07:57:03.321 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-20T07:57:03.321 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2024-01-20T07:57:03.321 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-20T07:57:03.321 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-20T07:57:03.321 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-20T07:57:03.322 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2024-01-20T07:57:03.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T07:57:03.428 INFO:teuthology.dispatcher.supervisor:Running job 7522412
2024-01-20T07:57:03.428 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412 --name yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/orig.config.yaml
2024-01-20T07:57:03.431 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412
2024-01-20T07:57:03.431 INFO:teuthology.dispatcher.supervisor:Job PID: 1377407
2024-01-20T07:57:03.432 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-20T07:59:03.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:01:03.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:03:03.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:05:03.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:07:04.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:09:04.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:11:04.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:13:04.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:15:04.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:17:04.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-20T08:17:05.057 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-20T08:17:05.177 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-20T08:17:05.177 INFO:teuthology.nuke:Checking targets against current locks
2024-01-20T08:17:05.222 DEBUG:teuthology.nuke:shortname: smithi100
2024-01-20T08:17:05.222 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-20T08:17:05.242 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 07:52:05.272212', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlrLNzBn88jFP2X1n6kxVC2c1uK3V5PoWfN2hhwa0xRva16SJ8jrcjQlFqFAsBr4NLSNKsS8NQpDYCRXpV392Y='}
2024-01-20T08:17:05.246 DEBUG:teuthology.nuke:shortname: smithi110
2024-01-20T08:17:05.246 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-20T08:17:05.267 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 07:52:05.273389', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFT2tsvTwJsCuCnLOw6OilTH6tN0pKxMSQvbzBE+jougwKWG72e6msyNu/hF5UnlGcrh3L0ZQb1wrDbW+/Hw5I='}
2024-01-20T08:17:05.286 INFO:teuthology.orchestra.console.smithi100:Power off
2024-01-20T08:17:05.286 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T08:17:05.308 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-01-20T08:17:05.308 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T08:17:05.322 INFO:teuthology.orchestra.console.smithi110:Power off
2024-01-20T08:17:05.322 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-20T08:17:05.332 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-01-20T08:17:05.348 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2024-01-20T08:17:05.348 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-20T08:17:05.369 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2024-01-20T08:17:05.433 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-01-20T08:17:05.470 INFO:teuthology.orchestra.console.smithi110:Power off completed
2024-01-20T08:17:05.589 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com
2024-01-20T08:17:05.614 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com