2023-09-03T13:01:57.215 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-03T13:01:57.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:01:57.363 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6766bc9670>, signals=[15]) 2023-09-03T13:01:57.366 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2023-09-03T13:01:57.366 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2023-09-03T13:01:57.366 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-03T13:01:57.390 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-09-03T13:01:57.390 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-09-03T13:01:57.390 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-09-03T13:01:57.392 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"} 2023-09-03T13:01:57.414 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-09-03T13:01:57.466 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-03T13:01:57.481 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-03T13:01:57.513 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_8.stream (ID 3) 2023-09-03T13:01:57.513 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 3} 2023-09-03T13:01:57.517 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_8.stream (ID 3) 2023-09-03T13:01:57.517 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 3} 2023-09-03T13:01:57.561 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream 2023-09-03T13:01:57.561 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:01:57.573 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2023-09-03T13:01:57.573 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:01:57.607 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"} 2023-09-03T13:01:57.612 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-09-03T13:01:57.646 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1} 2023-09-03T13:01:57.662 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-09-03T13:01:57.702 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:01:57.711 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:01:57.802 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-03T13:01:57.802 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T13:01:57.815 INFO:teuthology.orchestra.console.smithi181:Power off 2023-09-03T13:01:57.816 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T13:01:57.827 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-03T13:01:57.828 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:01:57.837 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-09-03T13:01:57.838 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:01:57.860 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-09-03T13:01:57.880 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-03T13:02:01.865 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:01.881 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:01.974 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-09-03T13:02:01.991 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-03T13:02:05.978 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:05.991 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:06.086 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-09-03T13:02:06.101 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-03T13:02:06.188 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-09-03T13:02:06.289 INFO:teuthology.orchestra.console.smithi181:Power on 2023-09-03T13:02:06.289 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-03T13:02:06.310 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-09-03T13:02:06.310 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:06.330 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-09-03T13:02:10.106 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:10.214 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-03T13:02:10.315 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-03T13:02:10.331 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:10.417 INFO:teuthology.orchestra.console.smithi096:Power on 2023-09-03T13:02:10.417 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-03T13:02:10.438 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2023-09-03T13:02:10.439 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:10.447 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-09-03T13:02:10.459 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-03T13:02:14.450 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:14.459 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:14.560 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-09-03T13:02:14.568 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-03T13:02:14.662 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-09-03T13:02:14.762 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-09-03T13:02:14.763 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:02:18.570 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T13:02:18.678 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-03T13:02:18.779 INFO:teuthology.orchestra.console.smithi096:Power on completed 2023-09-03T13:02:18.879 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2023-09-03T13:02:18.880 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:02:29.826 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:02:33.930 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:02:44.888 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:02:48.986 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:02:59.954 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:03:04.042 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:03:15.026 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:03:19.114 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:03:30.103 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:03:34.186 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:03:45.174 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:03:49.251 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:04:00.255 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:04:04.313 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:04:15.333 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:04:19.391 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:04:30.399 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:04:34.468 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:04:45.471 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-09-03T13:04:45.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:04:49.528 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-03T13:04:49.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:04:49.892 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed. 2023-09-03T13:04:49.893 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-03T13:04:49.894 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-03T13:04:49.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-03T13:05:03.902 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-09-03T13:05:09.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:05:12.986 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-09-03T13:05:18.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:05:22.046 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-09-03T13:05:28.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:05:31.098 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-09-03T13:05:37.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:05:40.154 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-09-03T13:05:46.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:06:46.159 WARNING:teuthology.provision.fog.smithi181:timed out 2023-09-03T13:06:49.882 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-03T13:06:49.883 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi096 2023-09-03T13:06:52.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:06:52.371 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-03T13:06:52.372 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-03T13:06:52.624 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-09-03T13:06:52.624 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-09-03T13:06:52.644 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2023-09-03T13:06:52.644 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2023-09-03T13:06:52.704 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-09-03T13:06:52.705 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-09-03T13:06:52.808 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2023-09-03T13:06:52.840 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-09-03T13:06:52.910 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2023-09-03T13:06:52.981 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-09-03T13:06:53.055 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-09-03T13:06:53.113 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-09-03T13:06:53.113 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2023-09-03T13:06:53.114 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-09-03T13:06:53.114 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-09-03T13:06:53.114 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2023-09-03T13:06:53.114 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-09-03T13:06:53.115 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-03T13:06:53.115 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-09-03T13:06:53.115 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-03T13:06:53.115 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-09-03T13:06:53.115 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-03T13:06:53.116 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-03T13:06:53.116 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-03T13:06:53.116 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-09-03T13:06:53.117 DEBUG:teuthology.parallel:result is None 2023-09-03T13:06:58.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-03T13:06:58.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:06:59.120 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-09-03T13:06:59.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-03T13:06:59.398 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-03T13:06:59.398 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-03T13:06:59.417 INFO:teuthology.provision.fog.smithi096:Node is ready 2023-09-03T13:06:59.417 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2023-09-03T13:06:59.476 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2023-09-03T13:06:59.476 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2023-09-03T13:06:59.537 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2023-09-03T13:06:59.538 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-03T13:06:59.640 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2023-09-03T13:06:59.670 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2023-09-03T13:06:59.740 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2023-09-03T13:06:59.808 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-03T13:06:59.875 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-03T13:06:59.934 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-09-03T13:06:59.934 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2023-09-03T13:06:59.934 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-09-03T13:06:59.934 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-09-03T13:06:59.935 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2023-09-03T13:06:59.935 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-03T13:06:59.935 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-03T13:06:59.935 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-03T13:06:59.935 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-03T13:06:59.936 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-09-03T13:06:59.936 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-03T13:06:59.936 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-03T13:06:59.936 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-03T13:06:59.936 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2023-09-03T13:06:59.937 DEBUG:teuthology.parallel:result is None 2023-09-03T13:07:00.098 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2023-09-03T13:07:00.100 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-03T13:07:00.120 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-09-03T13:07:00.120 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-03T13:07:00.138 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2023-09-03T13:07:00.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-03T13:07:00.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:07:00.205 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-09-03T13:07:00.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-03T13:07:00.272 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-09-03T13:07:00.329 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-09-03T13:07:00.329 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-03T13:07:00.386 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-09-03T13:07:00.386 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2023-09-03T13:07:00.386 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-09-03T13:07:00.386 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-09-03T13:07:00.387 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2023-09-03T13:07:00.387 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-03T13:07:00.387 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-03T13:07:00.387 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-03T13:07:00.388 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-03T13:07:00.388 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-09-03T13:07:00.388 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-03T13:07:00.388 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-03T13:07:00.388 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-03T13:07:00.389 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-03T13:07:00.412 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-09-03T13:07:00.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-09-03T13:07:00.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T13:07:00.478 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-09-03T13:07:00.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-09-03T13:07:00.551 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-09-03T13:07:00.612 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-09-03T13:07:00.612 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-09-03T13:07:00.672 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-09-03T13:07:00.673 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2023-09-03T13:07:00.673 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-09-03T13:07:00.673 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-09-03T13:07:00.673 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2023-09-03T13:07:00.673 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-09-03T13:07:00.674 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-03T13:07:00.674 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-09-03T13:07:00.674 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-03T13:07:00.674 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-09-03T13:07:00.675 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-03T13:07:00.675 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-03T13:07:00.675 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-03T13:07:00.675 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-09-03T13:07:00.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:07:00.772 INFO:teuthology.dispatcher.supervisor:Running job 7387698 2023-09-03T13:07:00.772 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi/7387698 --name dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi --description rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/qemu_xfstests} -- /home/teuthworker/archive/dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi/7387698/orig.config.yaml 2023-09-03T13:07:00.776 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi/7387698 2023-09-03T13:07:00.777 INFO:teuthology.dispatcher.supervisor:Job PID: 409578 2023-09-03T13:07:00.777 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-03T13:09:00.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:11:01.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:13:01.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:15:01.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:17:01.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:19:01.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:21:01.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:23:02.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:25:02.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:27:02.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:29:02.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:31:02.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:33:02.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:35:03.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:37:03.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:39:03.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:41:03.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:43:03.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:45:03.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:47:04.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:49:04.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:51:04.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:53:04.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:55:04.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:57:05.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T13:59:05.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:01:05.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:03:05.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:05:05.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:07:06.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:09:06.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:11:06.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:13:06.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:15:06.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:17:06.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:19:07.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:21:07.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:23:07.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:25:07.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:27:07.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:29:07.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:31:07.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:33:08.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:35:08.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:37:08.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:39:08.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:41:08.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:43:08.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:45:09.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:47:09.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:49:09.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:51:09.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T14:51:09.757 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-03T14:51:09.933 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi181 but it was locked by another job: /home/teuthworker/archive/rfriedma-2023-09-03_13:26:45-rados:thrash-wip-rf-1b1-v14-distro-default-smithi/7387822 2023-09-03T14:51:09.933 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-03T14:51:09.934 INFO:teuthology.nuke:Checking targets against current locks 2023-09-03T14:51:09.979 DEBUG:teuthology.nuke:shortname: smithi096 2023-09-03T14:51:09.979 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-03T14:51:09.982 INFO:teuthology.nuke:Not nuking smithi181.front.sepia.ceph.com because description doesn't match: dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi != /home/teuthworker/archive/rfriedma-2023-09-03_13:26:45-rados:thrash-wip-rf-1b1-v14-distro-default-smithi/7387822 2023-09-03T14:51:10.000 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi/7387698', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 13:01:56.407457', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnBeopf6MPMf/As96KphgM6QZBA3kZLK9AuMsPw4X4YA5fIVqh90AXpqnpHiKb8MfQeTYB8jcKl+WVSbZ8qFBriz6yrhwNdddlZfAZwvjEGtcrDhttX+8rgvJ7RPX8uQKFPjMwuu9JXOGzCXkpd4TpswdyYEjH1dsEJvwOA6ew9lQTSTxJg+VJHiM796cf5Gv2e717VwRNYIwHToveVQ2iTZBdb4ssO0NDkBdf2CUMZX89PJD7OEi3wP146kJxmxjNlfJMGA/XvGdDSXPZC6cHxGjhekmPETHF+zlHCL4byLzIo9q3jY3VgqVTGim9a0xH4xCV+cRYms3pWZWfiuNUXrRirnQgcJAc36yrCOWOvMU3gYyS3+wAKa9UN39PUy4x6GpIIAgG4zUnJxm/dkXPYXM3MuGgvHRiV3us9QnCNyGrkTSK9EoqVZ7yyQw4d7FUpm5L59KfWLYtt+qlVqMEeOkn60ij+f/2T+al3qIjUxGbp63RjqkDPnBwW8vowAc='} 2023-09-03T14:51:10.046 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-03T14:51:10.047 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T14:51:10.068 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-03T14:51:10.069 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T14:51:10.089 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-03T14:51:10.190 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-03T14:51:10.348 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com 2023-09-03T14:51:10.349 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmtVGrFgf3DWz3WWfzX1sfcAGqVvUPAvW9WnMYfvPhtn+DsJ9M/qZII8zuJ1RlvDOMA4ou/qUT5Kb12v0cK/jiUnsUiXkQUGUeFqlrfiJs6fNIFJD9ryY+eXKNtqdLWZZoKyCjiLo4I3pL/nMuZrOx54MitcAtWOqJbFo2PlhtLylBv1yFYrhYQhWS6ZYPwwRneHPYcSyi604Hjbyk48jBkZSRbsaNffL1HaQtzUSrZi/hJr3BODS9pDUc4/3j0v+Ptp/Jx51wRtQhD0Md+rNcofHSX7eQ2h//Eg8Kt7zcBRzcTBfbjSv0a0ySxsFATYPtM/kNuAF24EFmcX11C08eRjde6mVqN/kkhZ2Jtg1Vic4GnOzAfLaeyn7GtMuiZ3O6yM+EWAJgUhLlTN6T66Y2mZAqRotzJ1tBsWlvSXKStqpIOtEto4io/n9a3I/h0ngmqsp8bXOyuKDc2v1yn0nB2ntgzJ5klx6owNNLsHxYV1Dw5Ej/0sNkCb8qFzf1Dlk=