2023-12-19T14:13:17.520 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T14:13:17.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:13:17.649 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f76ea4082b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f76eb363940>, signals=[15])
2023-12-19T14:13:17.650 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-12-19T14:13:17.650 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T14:13:17.650 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-19T14:13:17.671 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging
2023-12-19T14:13:17.671 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T14:13:17.671 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2023-12-19T14:13:17.787 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_8.stream (ID 3)
2023-12-19T14:13:17.811 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_8.stream (ID 3)
2023-12-19T14:13:17.857 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.stream
2023-12-19T14:13:17.872 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 8.stream
2023-12-19T14:13:18.089 INFO:teuthology.orchestra.console.smithi172:Power off
2023-12-19T14:13:18.089 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T14:13:18.102 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-19T14:13:18.103 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T14:13:18.112 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off
2023-12-19T14:13:18.112 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:18.123 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-19T14:13:18.123 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:18.134 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-12-19T14:13:18.144 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-19T14:13:18.235 INFO:teuthology.orchestra.console.smithi172:Power off completed
2023-12-19T14:13:18.244 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-19T14:13:18.336 INFO:teuthology.orchestra.console.smithi172:Power on
2023-12-19T14:13:18.336 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T14:13:18.346 INFO:teuthology.orchestra.console.smithi111:Power on
2023-12-19T14:13:18.346 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T14:13:18.360 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On
2023-12-19T14:13:18.361 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:18.369 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-12-19T14:13:18.369 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:18.382 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-12-19T14:13:18.395 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-19T14:13:22.387 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:22.397 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:22.499 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-12-19T14:13:22.505 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-19T14:13:26.501 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:26.508 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:13:26.610 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on
2023-12-19T14:13:26.616 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-19T14:13:26.711 INFO:teuthology.orchestra.console.smithi172:Power on completed
2023-12-19T14:13:26.717 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-12-19T14:13:26.812 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish
2023-12-19T14:13:26.818 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-12-19T14:16:12.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:15.929 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:16:21.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:25.009 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:16:27.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:31.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:31.025 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:16:34.065 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:16:37.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:40.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:40.081 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:16:43.125 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:16:46.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:49.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:49.141 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:16:52.181 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:16:55.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:58.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:16:58.229 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:17:01.265 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:17:04.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:17:07.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:17:07.317 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:17:10.321 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:17:13.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:17:16.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:17:16.369 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:17:19.377 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-12-19T14:17:22.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:17:25.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:17:25.429 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:17:31.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:17:34.517 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-19T14:17:40.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:18:12.375 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T14:18:12.376 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T14:18:25.384 WARNING:teuthology.provision.fog.smithi172:timed out
2023-12-19T14:18:31.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:18:31.640 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T14:18:31.640 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T14:18:31.899 INFO:teuthology.provision.fog.smithi172:Node is ready
2023-12-19T14:18:31.899 DEBUG:teuthology.orchestra.run.smithi172:> hostname
2023-12-19T14:18:31.918 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com
2023-12-19T14:18:31.918 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts
2023-12-19T14:18:31.977 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172
2023-12-19T14:18:31.978 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2023-12-19T14:18:32.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts
2023-12-19T14:18:32.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts
2023-12-19T14:18:32.180 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname
2023-12-19T14:18:32.249 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2023-12-19T14:18:32.316 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2023-12-19T14:18:32.374 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream"
2023-12-19T14:18:32.374 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8"
2023-12-19T14:18:32.374 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos"
2023-12-19T14:18:32.374 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora"
2023-12-19T14:18:32.374 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T14:18:32.375 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T14:18:32.376 INFO:teuthology.provision.fog.smithi172:Deploy complete!
2023-12-19T14:18:32.377 DEBUG:teuthology.parallel:result is None
2023-12-19T14:18:37.901 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-12-19T14:18:37.901 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-12-19T14:18:37.925 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-12-19T14:18:37.926 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-12-19T14:18:37.987 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-12-19T14:18:38.011 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-19T14:18:38.106 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-12-19T14:18:38.136 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-12-19T14:18:38.206 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-12-19T14:18:38.275 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-19T14:18:38.343 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-19T14:18:38.402 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2023-12-19T14:18:38.403 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T14:18:38.403 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T14:18:38.403 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T14:18:38.403 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-12-19T14:18:38.403 DEBUG:teuthology.parallel:result is None
2023-12-19T14:18:38.555 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-12-19T14:18:38.556 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T14:18:38.582 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com
2023-12-19T14:18:38.582 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T14:18:38.600 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-12-19T14:18:38.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-19T14:18:38.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:18:38.670 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-12-19T14:18:38.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-19T14:18:38.744 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-12-19T14:18:38.802 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-12-19T14:18:38.802 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T14:18:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T14:18:38.861 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T14:18:38.861 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-19T14:18:38.883 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server
2023-12-19T14:18:38.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2023-12-19T14:18:38.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:18:38.951 DEBUG:teuthology.orchestra.run.smithi172:> true
2023-12-19T14:18:38.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com'
2023-12-19T14:18:38.980 DEBUG:teuthology.orchestra.run.smithi172:> uname -m
2023-12-19T14:18:39.041 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64
2023-12-19T14:18:39.041 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2023-12-19T14:18:39.101 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream"
2023-12-19T14:18:39.101 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8"
2023-12-19T14:18:39.101 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos"
2023-12-19T14:18:39.101 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora"
2023-12-19T14:18:39.101 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8"
2023-12-19T14:18:39.101 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2023-12-19T14:18:39.101 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-19T14:18:39.102 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2023-12-19T14:18:39.102 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-19T14:18:39.102 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/"
2023-12-19T14:18:39.102 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T14:18:39.102 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T14:18:39.102 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-19T14:18:39.102 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2023-12-19T14:18:39.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:18:39.207 INFO:teuthology.dispatcher.supervisor:Running job 7496863
2023-12-19T14:18:39.207 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496863 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496863/orig.config.yaml
2023-12-19T14:18:39.210 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496863
2023-12-19T14:18:39.211 INFO:teuthology.dispatcher.supervisor:Job PID: 1798658
2023-12-19T14:18:39.211 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-19T14:20:39.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:22:39.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:24:39.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:26:39.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:28:39.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:30:40.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:32:40.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:34:40.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:36:40.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:38:40.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:40:40.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:42:41.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:44:41.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:46:41.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:48:41.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:50:41.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:52:42.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:54:42.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:56:42.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:58:42.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:00:42.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:02:42.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:04:43.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:06:43.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:08:43.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:10:43.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:12:43.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:14:43.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:16:44.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:18:44.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:18:44.291 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-19T15:18:44.397 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-19T15:18:44.398 INFO:teuthology.nuke:Checking targets against current locks
2023-12-19T15:18:44.445 DEBUG:teuthology.nuke:shortname: smithi111
2023-12-19T15:18:44.446 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T15:18:44.468 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496863', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 14:13:16.506474', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOagBjJzBAfFB8spOYRRVzmSvBfOVNPyh0jiML8aZ9L6Z4zWwvge8bjxKf39ghjg+pQD61YiaC3nqjp0LHKt52I='}
2023-12-19T15:18:44.471 DEBUG:teuthology.nuke:shortname: smithi172
2023-12-19T15:18:44.472 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T15:18:44.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496863', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 14:13:16.508369', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPeZW8wUlbnWH2k8+SdnTrE80ij9zpCP6TDGQJL/mViZzspDfCWgeMLyn8DUUZPJnbXmJniaydhAIILjQty5lU='}
2023-12-19T15:18:44.518 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-19T15:18:44.518 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T15:18:44.544 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-19T15:18:44.545 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T15:18:44.563 INFO:teuthology.orchestra.console.smithi172:Power off
2023-12-19T15:18:44.563 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T15:18:44.572 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-19T15:18:44.585 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off
2023-12-19T15:18:44.586 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T15:18:44.610 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-12-19T15:18:44.673 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-19T15:18:44.712 INFO:teuthology.orchestra.console.smithi172:Power off completed
2023-12-19T15:18:44.824 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2023-12-19T15:18:44.857 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com