2024-03-01T19:35:15.658 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-03-01T19:35:15.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:35:15.857 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6df6a28f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6df7a89c10>, signals=[15])
2024-03-01T19:35:15.858 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2024-03-01T19:35:15.858 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T19:35:15.858 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-03-01T19:35:15.878 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2024-03-01T19:35:15.878 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T19:35:15.878 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2024-03-01T19:35:15.893 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging
2024-03-01T19:35:15.893 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T19:35:15.894 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2024-03-01T19:35:15.981 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T19:35:15.998 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T19:35:16.006 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T19:35:16.022 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream
2024-03-01T19:35:16.047 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 9.stream
2024-03-01T19:35:16.054 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 9.stream
2024-03-01T19:35:16.264 INFO:teuthology.orchestra.console.smithi028:Power off
2024-03-01T19:35:16.265 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T19:35:16.287 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2024-03-01T19:35:16.288 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:16.303 INFO:teuthology.orchestra.console.smithi053:Power off
2024-03-01T19:35:16.303 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T19:35:16.316 INFO:teuthology.orchestra.console.smithi050:Power off
2024-03-01T19:35:16.316 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T19:35:16.323 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-01T19:35:16.328 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2024-03-01T19:35:16.328 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:16.337 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2024-03-01T19:35:16.337 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:16.353 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-03-01T19:35:16.358 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-03-01T19:35:16.424 INFO:teuthology.orchestra.console.smithi028:Power off completed
2024-03-01T19:35:16.453 INFO:teuthology.orchestra.console.smithi053:Power off completed
2024-03-01T19:35:16.460 INFO:teuthology.orchestra.console.smithi050:Power off completed
2024-03-01T19:35:16.525 INFO:teuthology.orchestra.console.smithi028:Power on
2024-03-01T19:35:16.525 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T19:35:16.553 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2024-03-01T19:35:16.554 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:16.561 INFO:teuthology.orchestra.console.smithi053:Power on
2024-03-01T19:35:16.561 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T19:35:16.568 INFO:teuthology.orchestra.console.smithi050:Power on
2024-03-01T19:35:16.569 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T19:35:16.578 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-01T19:35:16.585 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On
2024-03-01T19:35:16.585 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:16.594 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On
2024-03-01T19:35:16.595 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:16.611 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-03-01T19:35:16.617 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-03-01T19:35:20.580 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:20.612 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:20.619 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:20.690 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-03-01T19:35:20.721 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-03-01T19:35:20.727 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-03-01T19:35:20.791 INFO:teuthology.orchestra.console.smithi028:Power on completed
2024-03-01T19:35:20.828 INFO:teuthology.orchestra.console.smithi050:Power on completed
2024-03-01T19:35:20.892 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2024-03-01T19:35:20.929 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2024-03-01T19:35:24.724 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T19:35:24.833 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2024-03-01T19:35:24.933 INFO:teuthology.orchestra.console.smithi053:Power on completed
2024-03-01T19:35:25.034 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish
2024-03-01T19:37:36.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:37:37.221 ERROR:teuthology.orchestra.connection:Error authenticating with smithi028.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-01T19:37:41.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:37:44.092 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-03-01T19:37:50.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:37:52.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:37:53.148 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-03-01T19:37:55.068 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-03-01T19:37:59.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:01.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:02.204 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-03-01T19:38:04.124 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-03-01T19:38:08.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:10.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:11.260 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-03-01T19:38:13.180 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-03-01T19:38:17.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:19.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:20.316 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-03-01T19:38:22.236 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-03-01T19:38:26.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:28.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:31.296 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-03-01T19:38:37.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:40.348 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-03-01T19:38:41.224 WARNING:teuthology.provision.fog.smithi028:timed out
2024-03-01T19:38:46.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:38:47.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:39:04.736 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T19:39:04.737 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T19:39:25.473 INFO:teuthology.provision.fog.smithi028:Node is ready
2024-03-01T19:39:25.473 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2024-03-01T19:39:25.493 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2024-03-01T19:39:25.493 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2024-03-01T19:39:25.551 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2024-03-01T19:39:25.551 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-03-01T19:39:25.670 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2024-03-01T19:39:25.704 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2024-03-01T19:39:25.777 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2024-03-01T19:39:25.848 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-03-01T19:39:25.923 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T19:39:25.976 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-03-01T19:39:25.977 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-03-01T19:39:25.977 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T19:39:25.977 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-03-01T19:39:25.977 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T19:39:25.977 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T19:39:25.977 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T19:39:25.978 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2024-03-01T19:39:25.979 DEBUG:teuthology.parallel:result is None
2024-03-01T19:39:26.320 WARNING:teuthology.provision.fog.smithi053:timed out
2024-03-01T19:39:32.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:39:32.546 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T19:39:32.546 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T19:39:32.877 INFO:teuthology.provision.fog.smithi053:Node is ready
2024-03-01T19:39:32.878 DEBUG:teuthology.orchestra.run.smithi053:> hostname
2024-03-01T19:39:32.893 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com
2024-03-01T19:39:32.893 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts
2024-03-01T19:39:32.949 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053
2024-03-01T19:39:32.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2024-03-01T19:39:33.075 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts
2024-03-01T19:39:33.107 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts
2024-03-01T19:39:33.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname
2024-03-01T19:39:33.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2024-03-01T19:39:33.321 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2024-03-01T19:39:33.376 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2024-03-01T19:39:33.377 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T19:39:33.378 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T19:39:33.378 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T19:39:33.378 INFO:teuthology.provision.fog.smithi053:Deploy complete!
2024-03-01T19:39:33.379 DEBUG:teuthology.parallel:result is None
2024-03-01T19:39:46.352 WARNING:teuthology.provision.fog.smithi050:timed out
2024-03-01T19:39:52.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:39:52.611 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T19:39:52.611 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T19:39:52.951 INFO:teuthology.provision.fog.smithi050:Node is ready
2024-03-01T19:39:52.951 DEBUG:teuthology.orchestra.run.smithi050:> hostname
2024-03-01T19:39:52.966 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2024-03-01T19:39:52.967 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts
2024-03-01T19:39:53.022 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2024-03-01T19:39:53.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-03-01T19:39:53.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts
2024-03-01T19:39:53.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts
2024-03-01T19:39:53.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname
2024-03-01T19:39:53.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-03-01T19:39:53.364 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2024-03-01T19:39:53.420 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2024-03-01T19:39:53.420 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T19:39:53.421 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T19:39:53.422 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2024-03-01T19:39:53.422 DEBUG:teuthology.parallel:result is None
2024-03-01T19:39:53.647 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2024-03-01T19:39:53.647 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T19:39:53.671 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2024-03-01T19:39:53.671 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T19:39:53.689 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com
2024-03-01T19:39:53.689 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T19:39:53.714 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2024-03-01T19:39:53.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-03-01T19:39:53.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:39:53.820 DEBUG:teuthology.orchestra.run.smithi028:> true
2024-03-01T19:39:54.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-03-01T19:39:54.002 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2024-03-01T19:39:54.058 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2024-03-01T19:39:54.058 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-03-01T19:39:54.112 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-03-01T19:39:54.112 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-03-01T19:39:54.112 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T19:39:54.113 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T19:39:54.114 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-03-01T19:39:54.129 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2024-03-01T19:39:54.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2024-03-01T19:39:54.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:39:54.230 DEBUG:teuthology.orchestra.run.smithi050:> true
2024-03-01T19:39:54.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com'
2024-03-01T19:39:54.300 DEBUG:teuthology.orchestra.run.smithi050:> uname -m
2024-03-01T19:39:54.355 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2024-03-01T19:39:54.356 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2024-03-01T19:39:54.412 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T19:39:54.413 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2024-03-01T19:39:54.413 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T19:39:54.413 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T19:39:54.413 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T19:39:54.413 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2024-03-01T19:39:54.437 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server
2024-03-01T19:39:54.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2024-03-01T19:39:54.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T19:39:54.547 DEBUG:teuthology.orchestra.run.smithi053:> true
2024-03-01T19:39:54.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com'
2024-03-01T19:39:54.730 DEBUG:teuthology.orchestra.run.smithi053:> uname -m
2024-03-01T19:39:54.785 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64
2024-03-01T19:39:54.785 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2024-03-01T19:39:54.840 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T19:39:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T19:39:54.842 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T19:39:54.842 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2024-03-01T19:39:54.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:39:54.980 INFO:teuthology.dispatcher.supervisor:Running job 7577758
2024-03-01T19:39:54.981 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577758 --name rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577758/orig.config.yaml
2024-03-01T19:39:54.984 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577758
2024-03-01T19:39:54.984 INFO:teuthology.dispatcher.supervisor:Job PID: 2785628
2024-03-01T19:39:54.985 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-01T19:41:54.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:43:55.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:45:55.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:47:55.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:49:55.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:51:55.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:53:55.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:55:55.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:57:55.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:59:55.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:01:55.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:03:55.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:05:55.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:07:55.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:09:56.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:11:56.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:13:56.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:15:56.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T20:15:56.330 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1