2024-02-04T20:59:53.486 INFO:root:teuthology version: 0.0.1.dev253+g6128cc3 2024-02-04T20:59:53.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T20:59:53.624 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f79f2f6fc10>, signals=[15]) 2024-02-04T20:59:53.625 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-02-04T20:59:53.625 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-02-04T20:59:53.625 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-02-04T20:59:53.644 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2024-02-04T20:59:53.645 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2024-02-04T20:59:53.645 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-02-04T20:59:53.759 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10) 2024-02-04T20:59:53.782 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_9.stream (ID 10) 2024-02-04T20:59:53.808 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream 2024-02-04T20:59:53.831 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 9.stream 2024-02-04T20:59:54.026 INFO:teuthology.orchestra.console.smithi105:Power off 2024-02-04T20:59:54.027 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-04T20:59:54.040 INFO:teuthology.orchestra.console.smithi135:Power off 2024-02-04T20:59:54.041 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-04T20:59:54.051 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-02-04T20:59:54.051 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T20:59:54.063 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2024-02-04T20:59:54.063 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T20:59:54.073 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-04T20:59:54.087 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-02-04T20:59:58.076 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T20:59:58.088 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T20:59:58.185 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-04T20:59:58.196 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-02-04T21:00:02.190 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:02.199 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:02.301 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-04T21:00:02.307 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-02-04T21:00:02.407 INFO:teuthology.orchestra.console.smithi135:Power off completed 2024-02-04T21:00:02.508 INFO:teuthology.orchestra.console.smithi135:Power on 2024-02-04T21:00:02.508 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-04T21:00:02.530 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2024-02-04T21:00:02.530 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:02.551 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-02-04T21:00:06.306 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:06.415 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-02-04T21:00:06.516 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-02-04T21:00:06.553 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:06.618 INFO:teuthology.orchestra.console.smithi105:Power on 2024-02-04T21:00:06.618 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-04T21:00:06.639 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-02-04T21:00:06.640 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:06.660 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-02-04T21:00:06.663 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-02-04T21:00:10.665 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:10.672 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:10.774 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-02-04T21:00:10.780 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-02-04T21:00:10.881 INFO:teuthology.orchestra.console.smithi135:Power on completed 2024-02-04T21:00:10.981 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2024-02-04T21:00:14.779 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-04T21:00:14.888 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-04T21:00:14.989 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-02-04T21:00:15.090 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-02-04T21:02:45.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:02:56.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:04.252 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-04T21:03:10.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:13.344 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-04T21:03:15.260 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-02-04T21:03:19.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:21.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:22.428 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-04T21:03:24.316 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-02-04T21:03:28.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:30.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:31.488 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-04T21:03:33.372 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-02-04T21:03:37.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:39.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:40.540 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-04T21:03:42.428 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-02-04T21:03:46.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:03:48.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:04:46.579 WARNING:teuthology.provision.fog.smithi105:timed out 2024-02-04T21:04:48.434 WARNING:teuthology.provision.fog.smithi135:timed out 2024-02-04T21:04:52.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:04:52.769 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-04T21:04:52.769 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-04T21:04:53.127 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-02-04T21:04:53.127 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-02-04T21:04:53.141 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2024-02-04T21:04:53.141 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2024-02-04T21:04:53.196 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2024-02-04T21:04:53.196 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-02-04T21:04:53.302 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2024-02-04T21:04:53.330 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2024-02-04T21:04:53.397 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2024-02-04T21:04:53.464 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-02-04T21:04:53.530 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-02-04T21:04:53.584 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-02-04T21:04:53.584 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-04T21:04:53.585 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-04T21:04:53.586 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-02-04T21:04:53.587 DEBUG:teuthology.parallel:result is None 2024-02-04T21:04:54.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:04:54.774 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-04T21:04:54.774 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-04T21:04:55.112 INFO:teuthology.provision.fog.smithi135:Node is ready 2024-02-04T21:04:55.112 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2024-02-04T21:04:55.126 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2024-02-04T21:04:55.126 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2024-02-04T21:04:55.185 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2024-02-04T21:04:55.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-02-04T21:04:55.291 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2024-02-04T21:04:55.319 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2024-02-04T21:04:55.390 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2024-02-04T21:04:55.461 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-02-04T21:04:55.531 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-02-04T21:04:55.589 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-02-04T21:04:55.589 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-04T21:04:55.590 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-04T21:04:55.590 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2024-02-04T21:04:55.591 DEBUG:teuthology.parallel:result is None 2024-02-04T21:04:55.786 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-02-04T21:04:55.787 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-04T21:04:55.809 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2024-02-04T21:04:55.809 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-04T21:04:55.827 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-02-04T21:04:55.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-02-04T21:04:55.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:04:55.916 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-02-04T21:04:55.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-02-04T21:04:55.984 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-02-04T21:04:56.039 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-02-04T21:04:56.039 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-02-04T21:04:56.094 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-04T21:04:56.095 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-02-04T21:04:56.095 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-04T21:04:56.095 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-04T21:04:56.095 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-04T21:04:56.095 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-02-04T21:04:56.117 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2024-02-04T21:04:56.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-02-04T21:04:56.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-04T21:04:56.203 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-02-04T21:04:56.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-02-04T21:04:56.269 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-02-04T21:04:56.327 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-02-04T21:04:56.327 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-04T21:04:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-02-04T21:04:56.386 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-02-04T21:04:56.386 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-04T21:04:56.386 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-02-04T21:04:56.386 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-04T21:04:56.386 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-04T21:04:56.386 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-04T21:04:56.386 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-02-04T21:04:56.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:04:56.486 INFO:teuthology.dispatcher.supervisor:Running job 7537736 2024-02-04T21:04:56.486 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2024-01-30_09:28:54-rados:verify-wip-end2end-tracing-distro-default-smithi/7537736 --name yuvalif-2024-01-30_09:28:54-rados:verify-wip-end2end-tracing-distro-default-smithi --description rados:verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuvalif-2024-01-30_09:28:54-rados:verify-wip-end2end-tracing-distro-default-smithi/7537736/orig.config.yaml 2024-02-04T21:04:56.489 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2024-01-30_09:28:54-rados:verify-wip-end2end-tracing-distro-default-smithi/7537736 2024-02-04T21:04:56.490 INFO:teuthology.dispatcher.supervisor:Job PID: 3030562 2024-02-04T21:04:56.490 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-04T21:06:56.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:08:56.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:10:56.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:12:57.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:14:57.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:16:57.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:18:57.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:20:57.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:22:57.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:24:58.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:26:58.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:28:58.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:30:58.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:32:58.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:34:58.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:36:59.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:38:59.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:40:59.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:42:59.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:44:59.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:46:59.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:49:00.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:51:00.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:53:00.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:55:00.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:57:00.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T21:59:00.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:01:01.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:03:01.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:05:01.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:07:01.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:09:01.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:11:01.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:13:01.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:15:02.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:17:02.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:19:02.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:21:02.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:23:02.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:25:02.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:27:03.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:29:03.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:31:03.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:33:03.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:35:03.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:37:04.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:39:04.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:41:04.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:43:04.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:45:04.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:47:04.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:49:04.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:51:05.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:53:05.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:55:05.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:57:05.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T22:59:05.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:01:05.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:03:06.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:05:06.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:07:06.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:09:06.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:11:06.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:13:06.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:15:07.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:17:07.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:19:07.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:21:07.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:23:07.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:25:07.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:27:08.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:29:08.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:31:08.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:33:08.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:35:08.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:37:08.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:39:09.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:41:09.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:43:09.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-04T23:43:09.443 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-04T23:43:09.628 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/cbodley-2024-02-04_22:11:20-rgw-wip-64255-distro-default-smithi/7546275 2024-02-04T23:43:09.629 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi135 but it was locked by another job: /home/teuthworker/archive/cbodley-2024-02-04_22:11:20-rgw-wip-64255-distro-default-smithi/7546276