2024-03-21T15:34:00.177 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-21T15:34:00.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:34:00.361 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fad29ef7f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fad2ae97c10>, signals=[15])
2024-03-21T15:34:00.361 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2024-03-21T15:34:00.362 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T15:34:00.362 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-03-21T15:34:00.386 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging
2024-03-21T15:34:00.386 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T15:34:00.386 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2024-03-21T15:34:00.411 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2024-03-21T15:34:00.411 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T15:34:00.412 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-03-21T15:34:00.499 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T15:34:00.530 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T15:34:00.542 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T15:34:00.560 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream
2024-03-21T15:34:00.568 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 9.stream
2024-03-21T15:34:00.585 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream
2024-03-21T15:34:00.781 INFO:teuthology.orchestra.console.smithi083:Power off
2024-03-21T15:34:00.781 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T15:34:00.799 INFO:teuthology.orchestra.console.smithi028:Power off
2024-03-21T15:34:00.800 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T15:34:00.813 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off
2024-03-21T15:34:00.813 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:00.827 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2024-03-21T15:34:00.827 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:00.842 INFO:teuthology.orchestra.console.smithi192:Power off
2024-03-21T15:34:00.842 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T15:34:00.851 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-21T15:34:00.852 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-03-21T15:34:00.863 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2024-03-21T15:34:00.863 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:00.884 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-21T15:34:00.952 INFO:teuthology.orchestra.console.smithi028:Power off completed
2024-03-21T15:34:00.952 INFO:teuthology.orchestra.console.smithi083:Power off completed
2024-03-21T15:34:00.986 INFO:teuthology.orchestra.console.smithi192:Power off completed
2024-03-21T15:34:01.053 INFO:teuthology.orchestra.console.smithi028:Power on
2024-03-21T15:34:01.053 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T15:34:01.061 INFO:teuthology.orchestra.console.smithi083:Power on
2024-03-21T15:34:01.062 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T15:34:01.078 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2024-03-21T15:34:01.079 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:01.086 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On
2024-03-21T15:34:01.086 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:01.094 INFO:teuthology.orchestra.console.smithi192:Power on
2024-03-21T15:34:01.094 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T15:34:01.103 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-21T15:34:01.108 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-03-21T15:34:01.117 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2024-03-21T15:34:01.117 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:01.140 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-21T15:34:05.108 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:05.116 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:05.142 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:05.218 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-21T15:34:05.223 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-03-21T15:34:05.250 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-03-21T15:34:05.350 INFO:teuthology.orchestra.console.smithi192:Power on completed
2024-03-21T15:34:05.451 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2024-03-21T15:34:09.220 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:09.226 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T15:34:09.329 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-03-21T15:34:09.334 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-03-21T15:34:09.430 INFO:teuthology.orchestra.console.smithi028:Power on completed
2024-03-21T15:34:09.435 INFO:teuthology.orchestra.console.smithi083:Power on completed
2024-03-21T15:34:09.531 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2024-03-21T15:34:09.535 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2024-03-21T15:36:25.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:36:28.414 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T15:36:34.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:36:36.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:36:36.514 ERROR:teuthology.orchestra.connection:Error authenticating with smithi192.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T15:36:37.502 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T15:36:40.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:36:43.486 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-21T15:36:43.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:36:46.558 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T15:36:49.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:36:52.542 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-21T15:36:52.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:36:55.619 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T15:36:58.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:01.602 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-21T15:37:01.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:04.670 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T15:37:07.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:10.654 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-21T15:37:10.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:16.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:19.710 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-21T15:37:25.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:28.766 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-21T15:37:34.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:37.822 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-21T15:37:40.517 WARNING:teuthology.provision.fog.smithi192:timed out
2024-03-21T15:37:43.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:46.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:49.598 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-21T15:37:55.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:37:58.654 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-21T15:38:04.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:07.710 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-21T15:38:10.673 WARNING:teuthology.provision.fog.smithi028:timed out
2024-03-21T15:38:13.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:16.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:16.766 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-21T15:38:16.931 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T15:38:16.932 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T15:38:17.228 INFO:teuthology.provision.fog.smithi028:Node is ready
2024-03-21T15:38:17.228 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2024-03-21T15:38:17.243 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2024-03-21T15:38:17.243 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2024-03-21T15:38:17.299 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2024-03-21T15:38:17.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-03-21T15:38:17.409 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2024-03-21T15:38:17.440 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2024-03-21T15:38:17.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2024-03-21T15:38:17.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-03-21T15:38:17.652 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T15:38:17.707 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-03-21T15:38:17.708 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T15:38:17.708 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T15:38:17.708 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T15:38:17.708 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2024-03-21T15:38:17.710 DEBUG:teuthology.parallel:result is None
2024-03-21T15:38:22.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:23.009 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T15:38:23.009 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T15:38:43.328 INFO:teuthology.provision.fog.smithi192:Node is ready
2024-03-21T15:38:43.328 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2024-03-21T15:38:43.346 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2024-03-21T15:38:43.346 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2024-03-21T15:38:43.403 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2024-03-21T15:38:43.404 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-03-21T15:38:43.529 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2024-03-21T15:38:43.560 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2024-03-21T15:38:43.628 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2024-03-21T15:38:43.698 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-03-21T15:38:43.765 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T15:38:43.821 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-03-21T15:38:43.822 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T15:38:43.822 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T15:38:43.822 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T15:38:43.822 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2024-03-21T15:38:43.822 DEBUG:teuthology.parallel:result is None
2024-03-21T15:38:43.826 WARNING:teuthology.provision.fog.smithi083:timed out
2024-03-21T15:38:49.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:50.349 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T15:38:50.349 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T15:38:50.666 INFO:teuthology.provision.fog.smithi083:Node is ready
2024-03-21T15:38:50.666 DEBUG:teuthology.orchestra.run.smithi083:> hostname
2024-03-21T15:38:50.681 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com
2024-03-21T15:38:50.681 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts
2024-03-21T15:38:50.736 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083
2024-03-21T15:38:50.736 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2024-03-21T15:38:50.861 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts
2024-03-21T15:38:50.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts
2024-03-21T15:38:50.957 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname
2024-03-21T15:38:51.024 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2024-03-21T15:38:51.091 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T15:38:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/"
2024-03-21T15:38:51.146 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T15:38:51.146 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T15:38:51.146 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T15:38:51.146 INFO:teuthology.provision.fog.smithi083:Deploy complete!
2024-03-21T15:38:51.147 DEBUG:teuthology.parallel:result is None
2024-03-21T15:38:51.361 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2024-03-21T15:38:51.361 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T15:38:51.386 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com
2024-03-21T15:38:51.387 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T15:38:51.403 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2024-03-21T15:38:51.403 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T15:38:51.424 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2024-03-21T15:38:51.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-03-21T15:38:51.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:51.527 DEBUG:teuthology.orchestra.run.smithi028:> true
2024-03-21T15:38:51.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-03-21T15:38:51.713 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2024-03-21T15:38:51.767 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2024-03-21T15:38:51.767 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-03-21T15:38:51.822 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-03-21T15:38:51.822 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-03-21T15:38:51.822 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-03-21T15:38:51.822 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-03-21T15:38:51.822 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-03-21T15:38:51.823 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-03-21T15:38:51.823 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T15:38:51.823 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-03-21T15:38:51.823 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-03-21T15:38:51.823 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T15:38:51.823 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-03-21T15:38:51.825 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T15:38:51.826 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T15:38:51.826 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T15:38:51.826 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-03-21T15:38:51.844 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server
2024-03-21T15:38:51.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2024-03-21T15:38:51.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:51.931 DEBUG:teuthology.orchestra.run.smithi083:> true
2024-03-21T15:38:52.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com'
2024-03-21T15:38:52.001 DEBUG:teuthology.orchestra.run.smithi083:> uname -m
2024-03-21T15:38:52.055 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64
2024-03-21T15:38:52.055 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2024-03-21T15:38:52.110 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream"
2024-03-21T15:38:52.110 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9"
2024-03-21T15:38:52.110 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos"
2024-03-21T15:38:52.110 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T15:38:52.111 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T15:38:52.112 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2024-03-21T15:38:52.136 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2024-03-21T15:38:52.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-03-21T15:38:52.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T15:38:52.225 DEBUG:teuthology.orchestra.run.smithi192:> true
2024-03-21T15:38:52.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-03-21T15:38:52.295 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2024-03-21T15:38:52.354 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2024-03-21T15:38:52.354 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-03-21T15:38:52.414 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-03-21T15:38:52.414 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-03-21T15:38:52.414 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-03-21T15:38:52.414 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-03-21T15:38:52.414 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-03-21T15:38:52.414 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-03-21T15:38:52.414 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T15:38:52.415 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-03-21T15:38:52.415 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-03-21T15:38:52.415 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T15:38:52.415 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-03-21T15:38:52.415 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T15:38:52.415 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T15:38:52.415 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T15:38:52.415 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-03-21T15:38:52.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:38:52.548 INFO:teuthology.dispatcher.supervisor:Running job 7613859
2024-03-21T15:38:52.548 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613859 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613859/orig.config.yaml
2024-03-21T15:38:52.552 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613859
2024-03-21T15:38:52.552 INFO:teuthology.dispatcher.supervisor:Job PID: 1688103
2024-03-21T15:38:52.552 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-21T15:40:52.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:42:52.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:44:52.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:46:52.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:48:52.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:50:52.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:52:52.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:54:53.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:56:53.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:58:53.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:00:53.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:02:53.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:04:53.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:06:53.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:08:53.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:10:53.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:12:53.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:14:53.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:16:53.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:18:53.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:20:53.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:22:54.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:24:54.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:26:54.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:28:54.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:30:54.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:32:54.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:34:54.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:36:54.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:38:54.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:40:54.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:42:54.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:44:54.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:46:54.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:48:55.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:50:55.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:52:55.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:54:55.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:56:55.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:58:55.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T17:00:55.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T17:02:55.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T17:04:55.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T17:06:55.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T17:08:55.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T17:10:55.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T17:10:55.987 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1