2023-08-22T22:06:44.454 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-22T22:06:44.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:06:44.595 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdaffa62ee0>, signals=[15]) 2023-08-22T22:06:44.597 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-08-22T22:06:44.598 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-08-22T22:06:44.598 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-08-22T22:06:44.626 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2023-08-22T22:06:44.626 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2023-08-22T22:06:44.626 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-08-22T22:06:44.628 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-08-22T22:06:44.650 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"} 2023-08-22T22:06:44.712 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-22T22:06:44.717 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-22T22:06:44.754 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2023-08-22T22:06:44.754 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 10} 2023-08-22T22:06:44.757 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10) 2023-08-22T22:06:44.757 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 10} 2023-08-22T22:06:44.797 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream 2023-08-22T22:06:44.798 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:06:44.801 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2023-08-22T22:06:44.801 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:06:44.848 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-08-22T22:06:44.851 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"} 2023-08-22T22:06:44.885 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-08-22T22:06:44.888 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1} 2023-08-22T22:06:44.937 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:06:44.939 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:06:45.034 INFO:teuthology.orchestra.console.smithi012:Power off 2023-08-22T22:06:45.035 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T22:06:45.051 INFO:teuthology.orchestra.console.smithi066:Power off 2023-08-22T22:06:45.052 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T22:06:45.062 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-08-22T22:06:45.062 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:45.072 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-08-22T22:06:45.073 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:45.085 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-22T22:06:45.094 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-08-22T22:06:49.088 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:49.098 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:49.201 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-22T22:06:49.209 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-08-22T22:06:53.204 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:53.214 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:53.316 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-22T22:06:53.327 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-22T22:06:53.428 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-08-22T22:06:53.530 INFO:teuthology.orchestra.console.smithi066:Power on 2023-08-22T22:06:53.530 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-22T22:06:53.552 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2023-08-22T22:06:53.553 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:53.577 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-22T22:06:57.320 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:57.430 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-22T22:06:57.532 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-08-22T22:06:57.578 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:57.637 INFO:teuthology.orchestra.console.smithi012:Power on 2023-08-22T22:06:57.638 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-22T22:06:57.661 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-08-22T22:06:57.662 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:06:57.689 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-22T22:06:57.690 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-22T22:07:01.694 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:07:01.702 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T22:07:01.804 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-22T22:07:01.846 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-08-22T22:07:01.907 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-08-22T22:07:01.947 INFO:teuthology.orchestra.console.smithi066:Power on completed 2023-08-22T22:07:02.008 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-08-22T22:07:02.009 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:07:02.049 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2023-08-22T22:07:02.050 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:07:17.084 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:07:17.110 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:07:32.160 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:07:32.169 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:07:47.236 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:07:47.237 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:08:02.312 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:08:02.315 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:08:17.404 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:08:17.406 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:08:32.488 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:08:32.491 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:08:47.572 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:08:47.575 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:09:02.660 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:09:02.662 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:09:17.744 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-22T22:09:17.745 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:09:17.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:09:17.949 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-08-22T22:09:17.951 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-22T22:09:17.952 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-22T22:09:17.953 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-22T22:09:32.826 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:09:47.897 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:10:02.969 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:10:18.036 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-22T22:10:18.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:10:21.168 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:10:27.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:10:30.224 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:10:36.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:10:39.280 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:10:45.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:10:48.340 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:10:54.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:10:57.392 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:11:03.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:11:06.448 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:11:09.040 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-22T22:11:09.042 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi012 2023-08-22T22:11:12.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:11:15.504 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:11:18.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-22T22:11:18.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:11:18.260 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-08-22T22:11:18.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-22T22:11:18.565 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-22T22:11:18.565 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-22T22:11:18.580 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-08-22T22:11:18.580 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-08-22T22:11:18.635 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-08-22T22:11:18.636 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-08-22T22:11:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-08-22T22:11:18.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-08-22T22:11:18.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-08-22T22:11:18.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-08-22T22:11:18.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-08-22T22:11:18.972 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-08-22T22:11:19.042 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-08-22T22:11:19.097 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-08-22T22:11:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-08-22T22:11:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-08-22T22:11:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-08-22T22:11:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-08-22T22:11:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-08-22T22:11:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-22T22:11:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-08-22T22:11:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-08-22T22:11:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-22T22:11:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-08-22T22:11:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T22:11:19.100 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-22T22:11:19.100 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-22T22:11:19.100 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-08-22T22:11:19.101 DEBUG:teuthology.parallel:result is None 2023-08-22T22:11:21.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:11:24.560 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:11:30.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:11:33.616 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:11:39.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:11:42.672 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:11:48.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:12:07.156 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:12:13.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:12:16.496 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-22T22:12:22.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:12:24.732 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-22T22:12:24.732 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-22T22:12:49.795 INFO:teuthology.provision.fog.smithi066:Node is ready 2023-08-22T22:12:49.795 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2023-08-22T22:12:49.815 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2023-08-22T22:12:49.815 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2023-08-22T22:12:49.872 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2023-08-22T22:12:49.872 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-08-22T22:12:50.014 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2023-08-22T22:12:50.049 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2023-08-22T22:12:50.123 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2023-08-22T22:12:50.196 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-08-22T22:12:50.268 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-08-22T22:12:50.323 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2023-08-22T22:12:50.324 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2023-08-22T22:12:50.324 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2023-08-22T22:12:50.325 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2023-08-22T22:12:50.325 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2023-08-22T22:12:50.325 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2023-08-22T22:12:50.325 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-22T22:12:50.325 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-08-22T22:12:50.325 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2023-08-22T22:12:50.325 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-22T22:12:50.326 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2023-08-22T22:12:50.326 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T22:12:50.326 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-22T22:12:50.326 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-22T22:12:50.327 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2023-08-22T22:12:50.327 DEBUG:teuthology.parallel:result is None 2023-08-22T22:12:50.511 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-08-22T22:12:50.512 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-22T22:12:50.536 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2023-08-22T22:12:50.537 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-22T22:12:50.562 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-08-22T22:12:50.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-22T22:12:50.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:12:50.661 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-08-22T22:12:50.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-22T22:12:50.806 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-08-22T22:12:50.860 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-08-22T22:12:50.861 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-08-22T22:12:50.914 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-08-22T22:12:50.915 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-08-22T22:12:50.915 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-08-22T22:12:50.915 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-08-22T22:12:50.915 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-08-22T22:12:50.915 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-08-22T22:12:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-22T22:12:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-08-22T22:12:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-08-22T22:12:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-22T22:12:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-08-22T22:12:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T22:12:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-22T22:12:50.917 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-22T22:12:50.917 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-08-22T22:12:50.935 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2023-08-22T22:12:50.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-08-22T22:12:50.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T22:12:51.033 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-08-22T22:12:51.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-08-22T22:12:51.104 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-08-22T22:12:51.159 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-08-22T22:12:51.159 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-08-22T22:12:51.215 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2023-08-22T22:12:51.216 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2023-08-22T22:12:51.216 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2023-08-22T22:12:51.216 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2023-08-22T22:12:51.216 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2023-08-22T22:12:51.216 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2023-08-22T22:12:51.216 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-22T22:12:51.217 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-08-22T22:12:51.217 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2023-08-22T22:12:51.217 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-22T22:12:51.217 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2023-08-22T22:12:51.217 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T22:12:51.217 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-22T22:12:51.217 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-22T22:12:51.218 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-08-22T22:12:51.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:12:51.406 INFO:teuthology.dispatcher.supervisor:Running job 7376720 2023-08-22T22:12:51.406 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376720 --name yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376720/orig.config.yaml 2023-08-22T22:12:51.410 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376720 2023-08-22T22:12:51.411 INFO:teuthology.dispatcher.supervisor:Job PID: 23338 2023-08-22T22:12:51.411 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-22T22:14:51.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:16:51.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:18:51.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:20:52.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:22:52.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:24:52.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:26:52.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:28:52.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:30:53.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:32:54.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:34:54.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:36:54.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:38:54.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:40:54.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:42:54.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:44:55.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:46:55.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:48:55.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:50:55.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:52:55.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:54:55.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:56:56.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T22:58:56.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:00:56.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:02:56.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:04:56.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:06:56.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:08:57.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:10:57.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:12:57.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:14:57.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:16:57.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:18:58.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:20:58.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:22:58.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:24:58.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:26:58.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:28:58.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:30:59.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:32:59.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:34:59.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:36:59.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:38:59.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:40:59.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:43:00.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:45:00.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:47:00.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:49:00.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:51:00.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:53:00.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:55:01.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:57:01.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T23:59:01.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:01:01.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:03:01.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:05:01.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:05:01.942 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-23T00:05:02.107 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-23T00:05:02.108 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T00:05:02.155 DEBUG:teuthology.nuke:shortname: smithi012 2023-08-23T00:05:02.155 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T00:05:02.179 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376720', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-22 22:06:43.649385', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtXezKKmV6+fDDDXgnpUYjL1fSjpunM4vLwe3bjuREVDU6nsA9judgx7OoP8/GC3HlqPo31dIAtIO2LABYPgw0='} 2023-08-23T00:05:02.182 DEBUG:teuthology.nuke:shortname: smithi066 2023-08-23T00:05:02.182 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T00:05:02.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376720', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-22 22:06:43.647573', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBINFXaZbjcv5HMoW9NLlfjC+1/9PfcXRs1mA2xEYCqmAsQRGRk+MmIJfPy1ZZWI5+pVzmRSWsg/ICWR0gPHlOvg='} 2023-08-23T00:05:02.238 INFO:teuthology.orchestra.console.smithi012:Power off 2023-08-23T00:05:02.239 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T00:05:02.261 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-08-23T00:05:02.262 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:05:02.278 INFO:teuthology.orchestra.console.smithi066:Power off 2023-08-23T00:05:02.279 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T00:05:02.290 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-23T00:05:02.302 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-08-23T00:05:02.303 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:05:02.328 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-23T00:05:02.392 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-08-23T00:05:02.429 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-08-23T00:05:02.542 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-08-23T00:05:02.575 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com