2024-03-26T17:58:00.158 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-26T17:58:00.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T17:58:00.343 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4752636f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4753697c10>, signals=[15])
2024-03-26T17:58:00.343 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging
2024-03-26T17:58:00.344 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T17:58:00.344 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2024-03-26T17:58:00.375 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-03-26T17:58:00.375 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T17:58:00.375 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-26T17:58:00.399 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging
2024-03-26T17:58:00.399 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T17:58:00.399 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2024-03-26T17:58:00.484 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_9.stream (ID 10)
2024-03-26T17:58:00.503 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_9.stream (ID 10)
2024-03-26T17:58:00.537 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 9.stream
2024-03-26T17:58:00.541 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_9.stream (ID 10)
2024-03-26T17:58:00.547 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 9.stream
2024-03-26T17:58:00.590 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 9.stream
2024-03-26T17:58:00.661 DEBUG:teuthology.provision.fog.smithi193:Canceling deploy task with ID 897565
2024-03-26T17:58:00.865 INFO:teuthology.orchestra.console.smithi100:Power off
2024-03-26T17:58:00.866 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T17:58:00.879 INFO:teuthology.orchestra.console.smithi055:Power off
2024-03-26T17:58:00.879 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T17:58:00.888 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-03-26T17:58:00.888 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:00.900 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off
2024-03-26T17:58:00.901 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:00.913 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-26T17:58:00.926 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-03-26T17:58:01.015 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-03-26T17:58:01.027 INFO:teuthology.orchestra.console.smithi055:Power off completed
2024-03-26T17:58:01.032 INFO:teuthology.orchestra.console.smithi193:Power off
2024-03-26T17:58:01.033 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T17:58:01.052 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off
2024-03-26T17:58:01.053 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:01.074 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-03-26T17:58:01.115 INFO:teuthology.orchestra.console.smithi100:Power on
2024-03-26T17:58:01.116 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T17:58:01.128 INFO:teuthology.orchestra.console.smithi055:Power on
2024-03-26T17:58:01.128 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T17:58:01.137 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-03-26T17:58:01.137 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:01.150 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On
2024-03-26T17:58:01.150 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:01.160 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-26T17:58:01.173 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-03-26T17:58:01.175 INFO:teuthology.orchestra.console.smithi193:Power off completed
2024-03-26T17:58:01.275 INFO:teuthology.orchestra.console.smithi193:Power on
2024-03-26T17:58:01.275 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T17:58:01.299 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On
2024-03-26T17:58:01.300 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:01.322 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-03-26T17:58:05.165 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:05.175 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:05.274 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-26T17:58:05.284 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-03-26T17:58:05.323 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:05.432 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-03-26T17:58:09.278 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:09.285 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:09.387 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-26T17:58:09.395 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2024-03-26T17:58:09.433 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T17:58:09.488 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-03-26T17:58:09.495 INFO:teuthology.orchestra.console.smithi055:Power on completed
2024-03-26T17:58:09.542 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on
2024-03-26T17:58:09.590 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-03-26T17:58:09.597 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish
2024-03-26T17:58:09.643 INFO:teuthology.orchestra.console.smithi193:Power on completed
2024-03-26T17:58:09.744 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish
2024-03-26T17:58:09.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:58:12.286 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:58:18.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:58:21.378 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:58:27.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:58:30.466 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:58:36.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:58:39.522 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:58:45.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:58:48.610 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:58:54.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:58:57.662 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:59:03.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:59:06.754 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:59:12.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:59:31.107 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:59:37.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:59:40.083 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T17:59:46.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T17:59:46.224 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-26T17:59:50.317 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-26T17:59:57.448 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-26T18:00:07.578 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-26T18:00:20.709 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-26T18:00:25.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:00:25.663 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-26T18:00:55.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:00:58.850 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-26T18:01:04.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:07.902 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-26T18:01:13.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:16.958 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-26T18:01:22.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:26.014 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-26T18:01:29.666 WARNING:teuthology.provision.fog.smithi055:timed out
2024-03-26T18:01:32.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:35.074 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-26T18:01:35.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:36.712 WARNING:teuthology.provision.fog.smithi193:timed out
2024-03-26T18:01:41.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:42.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:44.126 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-26T18:01:45.726 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T18:01:50.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:51.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:01:54.782 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T18:02:00.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:03.842 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T18:02:09.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:12.895 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-03-26T18:02:18.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:19.212 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T18:02:19.213 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T18:02:34.682 INFO:teuthology.provision.fog.smithi193:Node is ready
2024-03-26T18:02:34.682 DEBUG:teuthology.orchestra.run.smithi193:> hostname
2024-03-26T18:02:34.701 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com
2024-03-26T18:02:34.701 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts
2024-03-26T18:02:34.758 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2024-03-26T18:02:34.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2024-03-26T18:02:34.907 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts
2024-03-26T18:02:34.937 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts
2024-03-26T18:02:35.005 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname
2024-03-26T18:02:35.084 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2024-03-26T18:02:35.151 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2024-03-26T18:02:35.206 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream"
2024-03-26T18:02:35.206 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9"
2024-03-26T18:02:35.206 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos"
2024-03-26T18:02:35.206 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:02:35.206 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:02:35.207 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:02:35.208 INFO:teuthology.provision.fog.smithi193:Deploy complete!
2024-03-26T18:02:35.209 DEBUG:teuthology.parallel:result is None
2024-03-26T18:02:35.671 WARNING:teuthology.provision.fog.smithi055:timed out
2024-03-26T18:02:41.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:41.960 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T18:02:41.960 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T18:02:42.320 INFO:teuthology.provision.fog.smithi055:Node is ready
2024-03-26T18:02:42.320 DEBUG:teuthology.orchestra.run.smithi055:> hostname
2024-03-26T18:02:42.335 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com
2024-03-26T18:02:42.335 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts
2024-03-26T18:02:42.391 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055
2024-03-26T18:02:42.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2024-03-26T18:02:42.520 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts
2024-03-26T18:02:42.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts
2024-03-26T18:02:42.624 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname
2024-03-26T18:02:42.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2024-03-26T18:02:42.765 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release
2024-03-26T18:02:42.821 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream"
2024-03-26T18:02:42.821 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9"
2024-03-26T18:02:42.821 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos"
2024-03-26T18:02:42.821 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:02:42.821 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9"
2024-03-26T18:02:42.821 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:02:42.822 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:02:42.822 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2024-03-26T18:02:42.822 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:02:42.822 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:02:42.822 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:02:42.822 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:02:42.823 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:02:42.823 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:02:42.823 INFO:teuthology.provision.fog.smithi055:Deploy complete!
2024-03-26T18:02:42.824 DEBUG:teuthology.parallel:result is None
2024-03-26T18:02:50.131 WARNING:teuthology.provision.fog.smithi100:timed out
2024-03-26T18:02:56.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:56.410 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T18:02:56.410 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T18:02:56.756 INFO:teuthology.provision.fog.smithi100:Node is ready
2024-03-26T18:02:56.756 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2024-03-26T18:02:56.771 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2024-03-26T18:02:56.771 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts
2024-03-26T18:02:56.826 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2024-03-26T18:02:56.826 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-26T18:02:56.928 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts
2024-03-26T18:02:56.957 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2024-03-26T18:02:57.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname
2024-03-26T18:02:57.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-26T18:02:57.161 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-26T18:02:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:02:57.216 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:02:57.217 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2024-03-26T18:02:57.217 DEBUG:teuthology.parallel:result is None
2024-03-26T18:02:57.433 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com
2024-03-26T18:02:57.434 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T18:02:57.462 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2024-03-26T18:02:57.462 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T18:02:57.485 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com
2024-03-26T18:02:57.486 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server
2024-03-26T18:02:57.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com'
2024-03-26T18:02:57.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:57.594 DEBUG:teuthology.orchestra.run.smithi055:> true
2024-03-26T18:02:57.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com'
2024-03-26T18:02:57.777 DEBUG:teuthology.orchestra.run.smithi055:> uname -m
2024-03-26T18:02:57.833 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64
2024-03-26T18:02:57.834 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release
2024-03-26T18:02:57.888 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream"
2024-03-26T18:02:57.888 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:02:57.889 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:02:57.890 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2024-03-26T18:02:58.202 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2024-03-26T18:02:58.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-26T18:02:58.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:58.292 DEBUG:teuthology.orchestra.run.smithi100:> true
2024-03-26T18:02:58.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-26T18:02:58.363 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2024-03-26T18:02:58.419 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2024-03-26T18:02:58.419 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-03-26T18:02:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:02:58.476 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:02:58.476 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:02:58.476 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:02:58.476 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:02:58.476 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:02:58.477 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-26T18:02:58.519 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server
2024-03-26T18:02:58.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com'
2024-03-26T18:02:58.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:02:58.612 DEBUG:teuthology.orchestra.run.smithi193:> true
2024-03-26T18:02:58.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com'
2024-03-26T18:02:58.678 DEBUG:teuthology.orchestra.run.smithi193:> uname -m
2024-03-26T18:02:58.733 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64
2024-03-26T18:02:58.733 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:02:58.789 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:02:58.790 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:02:58.790 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:02:58.790 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2024-03-26T18:02:58.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:02:58.912 INFO:teuthology.dispatcher.supervisor:Running job 7623787
2024-03-26T18:02:58.912 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7623787 --name lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7623787/orig.config.yaml
2024-03-26T18:02:58.916 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7623787
2024-03-26T18:02:58.916 INFO:teuthology.dispatcher.supervisor:Job PID: 3003707
2024-03-26T18:02:58.916 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-26T18:04:58.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:06:58.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:08:59.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:10:59.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:12:59.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:14:59.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:14:59.498 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-03-26T18:14:59.640 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi193 but it was locked by another job: /home/teuthworker/archive/lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7623789