2023-10-10T12:58:01.857 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-10T12:58:01.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T12:58:02.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5d77966bb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5d78467670>, signals=[15])
2023-10-10T12:58:02.009 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2023-10-10T12:58:02.009 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2023-10-10T12:58:02.009 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-10-10T12:58:02.033 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-10-10T12:58:02.033 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-10-10T12:58:02.034 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-10T12:58:02.035 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"}
2023-10-10T12:58:02.061 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-10-10T12:58:02.114 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-10T12:58:02.135 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-10T12:58:02.152 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_8.stream (ID 3)
2023-10-10T12:58:02.152 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 3}
2023-10-10T12:58:02.177 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3)
2023-10-10T12:58:02.177 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 3}
2023-10-10T12:58:02.202 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream
2023-10-10T12:58:02.202 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:58:02.225 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2023-10-10T12:58:02.225 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:58:02.259 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"}
2023-10-10T12:58:02.271 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-10-10T12:58:02.297 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1}
2023-10-10T12:58:02.311 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-10-10T12:58:02.357 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:58:02.397 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:58:02.452 INFO:teuthology.orchestra.console.smithi049:Power off
2023-10-10T12:58:02.452 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T12:58:02.481 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-10-10T12:58:02.481 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:02.505 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-10T12:58:02.506 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T12:58:02.518 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-10-10T12:58:02.533 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-10T12:58:02.534 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:02.560 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-10-10T12:58:06.522 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:06.562 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:06.632 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-10-10T12:58:06.674 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-10-10T12:58:10.634 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:10.675 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:10.743 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-10T12:58:10.786 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-10-10T12:58:10.845 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-10-10T12:58:10.945 INFO:teuthology.orchestra.console.smithi049:Power on
2023-10-10T12:58:10.946 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-10T12:58:10.968 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On
2023-10-10T12:58:10.968 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:10.990 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-10T12:58:14.790 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:14.899 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-10T12:58:14.992 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:15.001 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-10T12:58:15.102 INFO:teuthology.orchestra.console.smithi099:Power on
2023-10-10T12:58:15.102 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-10T12:58:15.111 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-10T12:58:15.125 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2023-10-10T12:58:15.125 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:15.152 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-10T12:58:19.114 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:19.154 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:19.230 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-10-10T12:58:19.265 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-10T12:58:19.331 INFO:teuthology.orchestra.console.smithi049:Power on completed
2023-10-10T12:58:19.434 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2023-10-10T12:58:19.434 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:58:23.271 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T12:58:23.379 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-10-10T12:58:23.480 INFO:teuthology.orchestra.console.smithi099:Power on completed
2023-10-10T12:58:23.580 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-10-10T12:58:23.581 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:58:34.518 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:58:38.666 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:58:49.594 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:58:53.737 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:59:04.700 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:59:08.826 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:59:19.778 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:59:23.898 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:59:34.863 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:59:38.970 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T12:59:49.938 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T12:59:54.048 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T13:00:05.014 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:00:09.122 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T13:00:20.094 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:00:24.190 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T13:00:35.182 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:00:39.262 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T13:00:50.255 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:00:54.326 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T13:01:05.350 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:01:09.404 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-10T13:01:09.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:01:12.542 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-10T13:01:18.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:01:20.438 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:01:21.626 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-10T13:01:27.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:01:30.686 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-10T13:01:35.510 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:01:36.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:01:39.738 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-10T13:01:45.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:01:48.830 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-10T13:01:50.586 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-10T13:01:50.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:01:53.722 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:01:54.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:01:57.914 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-10T13:01:59.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:02.782 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:02:03.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:08.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:11.866 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:02:17.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:20.958 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:02:26.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:30.042 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:02:35.640 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-10T13:02:35.641 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-10T13:02:36.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:39.098 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:02:45.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:48.158 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:02:54.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:02:57.214 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:03:00.964 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-10-10T13:03:00.964 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-10-10T13:03:00.989 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-10-10T13:03:00.990 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-10-10T13:03:01.050 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-10-10T13:03:01.050 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-10T13:03:01.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-10-10T13:03:01.207 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-10-10T13:03:01.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-10-10T13:03:01.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-10T13:03:01.413 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-10T13:03:01.471 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-10T13:03:01.471 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2023-10-10T13:03:01.471 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-10T13:03:01.472 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-10T13:03:01.472 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2023-10-10T13:03:01.472 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-10-10T13:03:01.472 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-10T13:03:01.472 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-10T13:03:01.473 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-10T13:03:01.473 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-10T13:03:01.473 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-10T13:03:01.473 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-10T13:03:01.473 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-10T13:03:01.474 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-10-10T13:03:01.475 DEBUG:teuthology.parallel:result is None
2023-10-10T13:03:03.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:03:06.298 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:03:12.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:03:15.354 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:03:21.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:03:24.410 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-10T13:03:30.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:04:30.474 WARNING:teuthology.provision.fog.smithi049:timed out
2023-10-10T13:04:36.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:04:36.752 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-10T13:04:36.752 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-10T13:04:37.004 INFO:teuthology.provision.fog.smithi049:Node is ready
2023-10-10T13:04:37.004 DEBUG:teuthology.orchestra.run.smithi049:> hostname
2023-10-10T13:04:37.023 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2023-10-10T13:04:37.024 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts
2023-10-10T13:04:37.083 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2023-10-10T13:04:37.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2023-10-10T13:04:37.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts
2023-10-10T13:04:37.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts
2023-10-10T13:04:37.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname
2023-10-10T13:04:37.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2023-10-10T13:04:37.420 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2023-10-10T13:04:37.478 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2023-10-10T13:04:37.479 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2023-10-10T13:04:37.479 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2023-10-10T13:04:37.479 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2023-10-10T13:04:37.479 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2023-10-10T13:04:37.479 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2023-10-10T13:04:37.480 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-10T13:04:37.480 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2023-10-10T13:04:37.480 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-10T13:04:37.480 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2023-10-10T13:04:37.480 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-10T13:04:37.481 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-10T13:04:37.481 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-10T13:04:37.481 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2023-10-10T13:04:37.482 DEBUG:teuthology.parallel:result is None
2023-10-10T13:04:37.645 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2023-10-10T13:04:37.645 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-10T13:04:37.677 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-10-10T13:04:37.678 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-10T13:04:37.695 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2023-10-10T13:04:37.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-10-10T13:04:37.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:04:37.761 DEBUG:teuthology.orchestra.run.smithi049:> true
2023-10-10T13:04:37.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-10-10T13:04:37.829 DEBUG:teuthology.orchestra.run.smithi049:> uname -m
2023-10-10T13:04:37.887 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2023-10-10T13:04:37.888 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2023-10-10T13:04:37.945 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2023-10-10T13:04:37.946 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2023-10-10T13:04:37.946 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2023-10-10T13:04:37.946 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2023-10-10T13:04:37.946 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2023-10-10T13:04:37.947 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2023-10-10T13:04:37.947 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-10T13:04:37.947 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2023-10-10T13:04:37.947 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-10T13:04:37.948 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2023-10-10T13:04:37.948 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-10T13:04:37.948 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-10T13:04:37.948 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-10T13:04:37.949 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-10-10T13:04:37.969 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-10-10T13:04:37.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-10T13:04:37.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T13:04:38.039 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-10-10T13:04:38.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-10T13:04:38.178 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-10-10T13:04:38.236 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-10-10T13:04:38.237 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-10T13:04:38.296 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-10T13:04:38.296 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2023-10-10T13:04:38.296 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-10T13:04:38.296 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-10T13:04:38.297 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2023-10-10T13:04:38.297 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-10-10T13:04:38.297 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-10T13:04:38.297 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-10T13:04:38.297 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-10T13:04:38.298 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-10T13:04:38.298 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-10T13:04:38.298 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-10T13:04:38.298 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-10T13:04:38.299 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-10T13:04:38.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:04:38.412 INFO:teuthology.dispatcher.supervisor:Running job 7419636
2023-10-10T13:04:38.412 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419636 --name yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} -- /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419636/orig.config.yaml
2023-10-10T13:04:38.417 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419636
2023-10-10T13:04:38.418 INFO:teuthology.dispatcher.supervisor:Job PID: 3529187
2023-10-10T13:04:38.418 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-10T13:06:38.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:08:38.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:10:38.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:12:39.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:14:39.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:16:39.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:18:39.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:20:39.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:22:39.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T13:22:39.922 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-10T13:22:40.034 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-10T13:22:40.034 INFO:teuthology.nuke:Checking targets against current locks
2023-10-10T13:22:40.082 DEBUG:teuthology.nuke:shortname: smithi049
2023-10-10T13:22:40.083 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-10T13:22:40.106 DEBUG:teuthology.nuke:shortname: smithi099
2023-10-10T13:22:40.107 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-10T13:22:40.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419636', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 12:58:01.047758', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGM1VW+ZnZxPYo5qQDklyHvMnrmaVKFM7UE3XCWPKIjEzTJ4rcySvoj5pCNbdlC6ufqB1Z26+/eROuw/V/Yg0E='}
2023-10-10T13:22:40.134 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419636', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 12:58:01.045872', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNqY5QPPjNy/FzpxMMVHfmpNYGFbZuVxvz4SKDiZBIJ8DV00AQVherW//S+KsCONepImOmr0J5tpuTAVQ44w3KM='}
2023-10-10T13:22:40.159 INFO:teuthology.orchestra.console.smithi049:Power off
2023-10-10T13:22:40.160 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T13:22:40.180 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-10-10T13:22:40.181 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T13:22:40.197 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-10T13:22:40.198 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T13:22:40.217 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-10T13:22:40.218 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T13:22:40.226 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-10T13:22:40.242 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-10T13:22:40.328 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-10-10T13:22:40.343 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-10T13:22:40.479 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2023-10-10T13:22:40.495 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com