2024-02-08T01:20:29.780 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-08T01:20:29.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:20:29.956 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f698bba0c10>, signals=[15]) 2024-02-08T01:20:29.957 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-02-08T01:20:29.957 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T01:20:29.957 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-02-08T01:20:29.987 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2024-02-08T01:20:29.987 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T01:20:29.987 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-02-08T01:20:30.012 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2024-02-08T01:20:30.012 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T01:20:30.012 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-02-08T01:20:30.104 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T01:20:30.143 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T01:20:30.151 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T01:20:30.163 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2024-02-08T01:20:30.188 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 8.stream 2024-02-08T01:20:30.214 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2024-02-08T01:20:30.398 INFO:teuthology.orchestra.console.smithi133:Power off 2024-02-08T01:20:30.399 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T01:20:30.440 INFO:teuthology.orchestra.console.smithi144:Power off 2024-02-08T01:20:30.440 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T01:20:30.477 INFO:teuthology.orchestra.console.smithi186:Power off 2024-02-08T01:20:30.477 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T01:20:30.512 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2024-02-08T01:20:30.512 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:30.520 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2024-02-08T01:20:30.520 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:30.528 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-02-08T01:20:30.528 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:30.535 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-02-08T01:20:30.543 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-02-08T01:20:30.549 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-08T01:20:34.538 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:34.546 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:34.552 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:34.648 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-02-08T01:20:34.654 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-02-08T01:20:34.660 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-08T01:20:38.652 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:38.662 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:38.670 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:38.764 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2024-02-08T01:20:38.772 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-02-08T01:20:38.778 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-08T01:20:38.865 INFO:teuthology.orchestra.console.smithi144:Power off completed 2024-02-08T01:20:38.879 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-02-08T01:20:38.966 INFO:teuthology.orchestra.console.smithi144:Power on 2024-02-08T01:20:38.966 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T01:20:38.980 INFO:teuthology.orchestra.console.smithi133:Power on 2024-02-08T01:20:38.980 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T01:20:38.988 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2024-02-08T01:20:38.988 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:39.001 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-02-08T01:20:39.002 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:39.011 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2024-02-08T01:20:39.025 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-08T01:20:42.776 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:42.887 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-02-08T01:20:42.988 INFO:teuthology.orchestra.console.smithi186:Power off completed 2024-02-08T01:20:43.012 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:43.026 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:43.089 INFO:teuthology.orchestra.console.smithi186:Power on 2024-02-08T01:20:43.090 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T01:20:43.113 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2024-02-08T01:20:43.113 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:43.122 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2024-02-08T01:20:43.133 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-02-08T01:20:43.136 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-08T01:20:47.127 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:47.135 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:47.141 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:47.237 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-02-08T01:20:47.243 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-02-08T01:20:47.250 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-08T01:20:47.338 INFO:teuthology.orchestra.console.smithi144:Power on completed 2024-02-08T01:20:47.351 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-02-08T01:20:47.439 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2024-02-08T01:20:47.452 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-02-08T01:20:51.248 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T01:20:51.418 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-02-08T01:20:51.519 INFO:teuthology.orchestra.console.smithi186:Power on completed 2024-02-08T01:20:51.619 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2024-02-08T01:23:18.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:23:33.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:23:36.316 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-08T01:23:37.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:23:40.384 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:23:42.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:23:45.372 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-08T01:23:46.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:23:49.436 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:23:51.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:23:54.432 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-08T01:23:55.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:23:58.492 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:24:00.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:03.484 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-08T01:24:04.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:07.548 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:24:09.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:12.540 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-08T01:24:13.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:16.604 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:24:18.240 ERROR:teuthology.orchestra.connection:Error authenticating with smithi144.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect server_key = t.get_remote_server_key() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-02-08T01:24:18.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:22.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:25.660 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:24:31.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:34.716 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:24:40.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:24:44.000 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-02-08T01:24:50.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:25:18.544 WARNING:teuthology.provision.fog.smithi133:timed out 2024-02-08T01:25:20.572 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-02-08T01:25:22.248 WARNING:teuthology.provision.fog.smithi144:timed out 2024-02-08T01:25:24.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:25:24.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T01:25:24.791 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T01:25:25.075 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-02-08T01:25:25.075 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-02-08T01:25:25.095 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-02-08T01:25:25.095 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-02-08T01:25:25.154 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-02-08T01:25:25.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-02-08T01:25:25.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-02-08T01:25:25.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-02-08T01:25:25.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-02-08T01:25:25.408 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-02-08T01:25:25.475 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T01:25:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T01:25:25.534 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-02-08T01:25:25.536 DEBUG:teuthology.parallel:result is None 2024-02-08T01:25:28.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:25:28.480 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T01:25:28.481 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T01:25:28.774 INFO:teuthology.provision.fog.smithi144:Node is ready 2024-02-08T01:25:28.774 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2024-02-08T01:25:28.795 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2024-02-08T01:25:28.795 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2024-02-08T01:25:28.857 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2024-02-08T01:25:28.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2024-02-08T01:25:28.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2024-02-08T01:25:28.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2024-02-08T01:25:29.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2024-02-08T01:25:29.138 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2024-02-08T01:25:29.207 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-02-08T01:25:29.266 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-02-08T01:25:29.266 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T01:25:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T01:25:29.268 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2024-02-08T01:25:29.268 DEBUG:teuthology.parallel:result is None 2024-02-08T01:25:50.024 WARNING:teuthology.provision.fog.smithi186:timed out 2024-02-08T01:25:56.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:25:56.300 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T01:25:56.300 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T01:25:56.553 INFO:teuthology.provision.fog.smithi186:Node is ready 2024-02-08T01:25:56.553 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2024-02-08T01:25:56.573 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2024-02-08T01:25:56.573 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2024-02-08T01:25:56.632 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2024-02-08T01:25:56.632 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2024-02-08T01:25:56.741 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2024-02-08T01:25:56.770 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2024-02-08T01:25:56.838 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2024-02-08T01:25:56.906 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2024-02-08T01:25:56.973 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-02-08T01:25:57.032 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T01:25:57.033 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T01:25:57.033 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T01:25:57.033 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2024-02-08T01:25:57.034 DEBUG:teuthology.parallel:result is None 2024-02-08T01:25:57.225 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-02-08T01:25:57.225 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T01:25:57.248 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2024-02-08T01:25:57.248 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T01:25:57.272 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2024-02-08T01:25:57.273 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T01:25:57.290 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-02-08T01:25:57.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-08T01:25:57.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:25:57.362 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-08T01:25:57.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-08T01:25:57.585 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-02-08T01:25:57.604 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-02-08T01:25:57.604 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T01:25:57.663 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T01:25:57.664 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T01:25:57.664 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-02-08T01:25:57.689 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2024-02-08T01:25:57.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-02-08T01:25:57.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:25:57.763 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-02-08T01:25:57.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-02-08T01:25:57.857 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-02-08T01:25:57.916 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-02-08T01:25:57.916 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-02-08T01:25:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-02-08T01:25:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2024-02-08T01:25:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-02-08T01:25:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-02-08T01:25:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2024-02-08T01:25:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2024-02-08T01:25:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T01:25:57.976 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-02-08T01:25:57.976 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T01:25:57.976 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-02-08T01:25:57.976 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T01:25:57.976 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T01:25:57.976 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T01:25:57.976 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-02-08T01:25:57.997 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2024-02-08T01:25:57.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-02-08T01:25:57.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T01:25:58.070 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-02-08T01:25:58.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-02-08T01:25:58.141 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-02-08T01:25:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-02-08T01:25:58.201 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-02-08T01:25:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T01:25:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T01:25:58.262 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-02-08T01:25:58.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:25:58.360 INFO:teuthology.dispatcher.supervisor:Running job 7550547 2024-02-08T01:25:58.361 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi/7550547 --name yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi/7550547/orig.config.yaml 2024-02-08T01:25:58.364 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi/7550547 2024-02-08T01:25:58.364 INFO:teuthology.dispatcher.supervisor:Job PID: 2458921 2024-02-08T01:25:58.364 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-08T01:27:58.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:29:58.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:31:58.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:33:58.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:35:59.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:37:59.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:39:59.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T01:39:59.522 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1