2023-09-11T05:49:47.633 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-11T05:49:47.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T05:49:47.781 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f79e824f670>, signals=[15]) 2023-09-11T05:49:47.782 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-09-11T05:49:47.783 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T05:49:47.783 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-09-11T05:49:47.802 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-09-11T05:49:47.803 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T05:49:47.803 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-11T05:49:47.804 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-09-11T05:49:47.827 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-09-11T05:49:47.872 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-11T05:49:47.894 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-11T05:49:47.921 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10) 2023-09-11T05:49:47.921 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 10} 2023-09-11T05:49:47.935 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10) 2023-09-11T05:49:47.935 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 10} 2023-09-11T05:49:47.968 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream 2023-09-11T05:49:47.968 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:49:47.990 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream 2023-09-11T05:49:47.990 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:49:48.031 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T05:49:48.044 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T05:49:48.068 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-09-11T05:49:48.087 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-09-11T05:49:48.123 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:49:48.136 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:49:48.220 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-11T05:49:48.221 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T05:49:48.235 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-11T05:49:48.236 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T05:49:48.243 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-11T05:49:48.243 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:48.256 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-11T05:49:48.257 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:48.264 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-11T05:49:48.282 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-11T05:49:52.269 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:52.283 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:52.377 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-11T05:49:52.392 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-11T05:49:56.382 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:56.393 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:56.491 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-11T05:49:56.500 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-11T05:49:56.593 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-11T05:49:56.602 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-11T05:49:56.694 INFO:teuthology.orchestra.console.smithi002:Power on 2023-09-11T05:49:56.695 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T05:49:56.703 INFO:teuthology.orchestra.console.smithi017:Power on 2023-09-11T05:49:56.704 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T05:49:56.719 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-09-11T05:49:56.719 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:56.727 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-09-11T05:49:56.728 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:49:56.739 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-11T05:49:56.748 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-11T05:50:00.742 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:50:00.749 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:50:00.851 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-11T05:50:00.860 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-11T05:50:04.854 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:50:04.861 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T05:50:04.963 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-11T05:50:04.972 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-11T05:50:05.065 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-09-11T05:50:05.073 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-09-11T05:50:05.166 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-09-11T05:50:05.166 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:50:05.175 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-09-11T05:50:05.175 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:50:20.250 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:50:20.251 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:50:35.330 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:50:35.331 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:50:50.418 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:50:50.419 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:51:05.502 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:51:05.503 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:51:20.578 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:51:20.579 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:51:35.658 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:51:35.659 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:51:50.750 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:51:50.751 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:52:05.834 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:52:05.835 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:52:20.922 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-11T05:52:20.923 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:52:20.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:52:24.062 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-11T05:52:30.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:52:33.150 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-11T05:52:35.989 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-11T05:52:36.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:52:39.130 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-11T05:52:39.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:52:42.202 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-11T05:52:45.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:52:48.186 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-11T05:52:48.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:52:51.258 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-11T05:52:54.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:52:57.242 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-11T05:52:57.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:53:00.318 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-11T05:53:03.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:53:06.298 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-11T05:53:06.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:53:09.370 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-11T05:53:12.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:53:15.358 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-11T05:53:15.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:53:21.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:54:15.426 WARNING:teuthology.provision.fog.smithi002:timed out 2023-09-11T05:54:21.370 WARNING:teuthology.provision.fog.smithi017:timed out 2023-09-11T05:54:21.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:54:21.705 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T05:54:21.706 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T05:54:22.041 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-09-11T05:54:22.042 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-09-11T05:54:22.058 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-09-11T05:54:22.058 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-09-11T05:54:22.113 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-09-11T05:54:22.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-11T05:54:22.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-09-11T05:54:22.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-09-11T05:54:22.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-09-11T05:54:22.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-11T05:54:22.497 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-09-11T05:54:22.552 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-09-11T05:54:22.552 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2023-09-11T05:54:22.553 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-09-11T05:54:22.553 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-09-11T05:54:22.553 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2023-09-11T05:54:22.553 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2023-09-11T05:54:22.553 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T05:54:22.554 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-09-11T05:54:22.554 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2023-09-11T05:54:22.554 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T05:54:22.554 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-09-11T05:54:22.555 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T05:54:22.555 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T05:54:22.555 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T05:54:22.556 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-09-11T05:54:22.557 DEBUG:teuthology.parallel:result is None 2023-09-11T05:54:27.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:54:27.605 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T05:54:27.605 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T05:54:27.961 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-09-11T05:54:27.962 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-09-11T05:54:27.977 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-09-11T05:54:27.978 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-09-11T05:54:28.034 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-09-11T05:54:28.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-11T05:54:28.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-09-11T05:54:28.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-09-11T05:54:28.246 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-09-11T05:54:28.318 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-11T05:54:28.388 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-11T05:54:28.444 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-09-11T05:54:28.444 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2023-09-11T05:54:28.445 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-09-11T05:54:28.445 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-09-11T05:54:28.445 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2023-09-11T05:54:28.445 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2023-09-11T05:54:28.445 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T05:54:28.446 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-09-11T05:54:28.446 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2023-09-11T05:54:28.446 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T05:54:28.446 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-09-11T05:54:28.447 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T05:54:28.447 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T05:54:28.447 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T05:54:28.447 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-09-11T05:54:28.448 DEBUG:teuthology.parallel:result is None 2023-09-11T05:54:28.624 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-09-11T05:54:28.625 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T05:54:28.667 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-09-11T05:54:28.667 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T05:54:28.693 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-09-11T05:54:28.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-09-11T05:54:28.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:54:28.792 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-09-11T05:54:28.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-09-11T05:54:28.863 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-09-11T05:54:28.919 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-09-11T05:54:28.919 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-09-11T05:54:28.976 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-09-11T05:54:28.976 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2023-09-11T05:54:28.976 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-09-11T05:54:28.977 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-09-11T05:54:28.977 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2023-09-11T05:54:28.977 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2023-09-11T05:54:28.977 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T05:54:28.977 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-09-11T05:54:28.978 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2023-09-11T05:54:28.978 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T05:54:28.978 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-09-11T05:54:28.978 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T05:54:28.978 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T05:54:28.979 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T05:54:28.979 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-09-11T05:54:29.001 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-09-11T05:54:29.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-11T05:54:29.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T05:54:29.098 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-09-11T05:54:29.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-11T05:54:29.171 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-09-11T05:54:29.229 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-09-11T05:54:29.229 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-11T05:54:29.286 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-09-11T05:54:29.286 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2023-09-11T05:54:29.287 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-09-11T05:54:29.287 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-09-11T05:54:29.287 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2023-09-11T05:54:29.287 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2023-09-11T05:54:29.288 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T05:54:29.288 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-09-11T05:54:29.288 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2023-09-11T05:54:29.288 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T05:54:29.289 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-09-11T05:54:29.289 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T05:54:29.289 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T05:54:29.290 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T05:54:29.290 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-11T05:54:29.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T05:54:29.408 INFO:teuthology.dispatcher.supervisor:Running job 7392919 2023-09-11T05:54:29.408 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-11_04:57:08-fs-wip-vshankar-testing-20230908.065909-testing-default-smithi/7392919 --name vshankar-2023-09-11_04:57:08-fs-wip-vshankar-testing-20230908.065909-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} -- /home/teuthworker/archive/vshankar-2023-09-11_04:57:08-fs-wip-vshankar-testing-20230908.065909-testing-default-smithi/7392919/orig.config.yaml 2023-09-11T05:54:29.413 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-11_04:57:08-fs-wip-vshankar-testing-20230908.065909-testing-default-smithi/7392919 2023-09-11T05:54:29.413 INFO:teuthology.dispatcher.supervisor:Job PID: 2938861 2023-09-11T05:54:29.414 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-11T05:56:29.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T05:58:29.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:00:29.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:02:30.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:04:30.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:06:30.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:08:30.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:10:30.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:12:30.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:14:31.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:16:31.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:18:31.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:20:31.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:22:31.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:24:31.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:26:32.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:28:32.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:30:32.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:32:32.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:34:32.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:36:32.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:38:33.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:40:33.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:42:33.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:44:33.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:46:33.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:48:34.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:50:34.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:52:34.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:54:34.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:56:34.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T06:58:34.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T07:00:35.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T07:02:35.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T07:02:35.456 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-11T07:02:35.748 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-11T07:02:35.749 INFO:teuthology.nuke:Checking targets against current locks 2023-09-11T07:02:35.795 DEBUG:teuthology.nuke:shortname: smithi002 2023-09-11T07:02:35.795 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T07:02:35.820 DEBUG:teuthology.nuke:shortname: smithi017 2023-09-11T07:02:35.821 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T07:02:35.824 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-11_04:57:08-fs-wip-vshankar-testing-20230908.065909-testing-default-smithi/7392919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 05:49:46.807695', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCaEaQ/4Zs2+xCaMDvZAgSFBvYje1LdAu7MkT+cemalkQUvr4Irk8MPxG76Mgo2h5nWJTDFRgnttRA/oaMBW2TA='} 2023-09-11T07:02:35.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-11_04:57:08-fs-wip-vshankar-testing-20230908.065909-testing-default-smithi/7392919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 05:49:46.809667', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN75l3b7fBPsMGMqObjtv1JnUzztExIxJL+kKYzseV/QFJkGy2YioB6xNwbV+mhpb3cVQ/ujhAEQLSf8p9gMg/k='} 2023-09-11T07:02:35.879 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-11T07:02:35.880 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T07:02:35.895 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-11T07:02:35.896 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T07:02:35.904 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-11T07:02:35.904 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T07:02:35.919 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-11T07:02:35.920 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T07:02:35.927 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-11T07:02:35.940 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-11T07:02:36.029 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-11T07:02:36.042 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-11T07:02:36.180 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-09-11T07:02:36.188 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com