2024-02-13T05:01:46.789 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-02-13T05:01:46.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-13T05:01:46.956 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f23370a6f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2338107c10>, signals=[15])
2024-02-13T05:01:46.957 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2024-02-13T05:01:46.957 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2024-02-13T05:01:46.957 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-02-13T05:01:46.980 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2024-02-13T05:01:46.980 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2024-02-13T05:01:46.980 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-02-13T05:01:46.996 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging
2024-02-13T05:01:46.996 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server
2024-02-13T05:01:46.997 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2024-02-13T05:01:47.084 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10)
2024-02-13T05:01:47.120 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10)
2024-02-13T05:01:47.140 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream
2024-02-13T05:01:47.143 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_9.stream (ID 10)
2024-02-13T05:01:47.163 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream
2024-02-13T05:01:47.195 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 9.stream
2024-02-13T05:01:47.398 INFO:teuthology.orchestra.console.smithi019:Power off
2024-02-13T05:01:47.398 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-13T05:01:47.410 INFO:teuthology.orchestra.console.smithi040:Power off
2024-02-13T05:01:47.410 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-13T05:01:47.422 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2024-02-13T05:01:47.422 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:47.431 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2024-02-13T05:01:47.431 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:47.446 INFO:teuthology.orchestra.console.smithi204:Power off
2024-02-13T05:01:47.447 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-13T05:01:47.454 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-02-13T05:01:47.455 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-02-13T05:01:47.467 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off
2024-02-13T05:01:47.467 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:47.491 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-02-13T05:01:51.457 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:51.464 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:51.492 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:51.566 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-02-13T05:01:51.573 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-02-13T05:01:51.600 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-02-13T05:01:55.571 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:55.578 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:55.601 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:55.680 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-02-13T05:01:55.686 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-02-13T05:01:55.710 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-02-13T05:01:55.781 INFO:teuthology.orchestra.console.smithi019:Power off completed
2024-02-13T05:01:55.881 INFO:teuthology.orchestra.console.smithi019:Power on
2024-02-13T05:01:55.882 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-13T05:01:55.902 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On
2024-02-13T05:01:55.903 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:55.923 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-02-13T05:01:59.688 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:59.710 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:01:59.798 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-02-13T05:01:59.817 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-02-13T05:01:59.899 INFO:teuthology.orchestra.console.smithi040:Power off completed
2024-02-13T05:01:59.918 INFO:teuthology.orchestra.console.smithi204:Power off completed
2024-02-13T05:01:59.925 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:02:00.000 INFO:teuthology.orchestra.console.smithi040:Power on
2024-02-13T05:02:00.001 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-13T05:02:00.019 INFO:teuthology.orchestra.console.smithi204:Power on
2024-02-13T05:02:00.019 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-13T05:02:00.027 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On
2024-02-13T05:02:00.028 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:02:00.035 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-02-13T05:02:00.039 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On
2024-02-13T05:02:00.039 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:02:00.047 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-02-13T05:02:00.059 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-02-13T05:02:04.036 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:02:04.049 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:02:04.060 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-13T05:02:04.144 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-02-13T05:02:04.157 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-02-13T05:02:04.168 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-02-13T05:02:04.245 INFO:teuthology.orchestra.console.smithi019:Power on completed
2024-02-13T05:02:04.257 INFO:teuthology.orchestra.console.smithi040:Power on completed
2024-02-13T05:02:04.269 INFO:teuthology.orchestra.console.smithi204:Power on completed
2024-02-13T05:02:04.346 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2024-02-13T05:02:04.358 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2024-02-13T05:02:04.370 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish
2024-02-13T05:02:04.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:02:23.036 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:02:29.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:02:32.124 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:02:38.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:02:41.180 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:02:47.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:02:50.236 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:02:56.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:02:59.292 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:03:05.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:03:08.348 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:03:14.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:03:17.436 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:03:23.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:03:29.532 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:03:35.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:03:38.588 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:03:44.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:03:44.597 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:03:50.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:03:50.732 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:03:54.862 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:04:01.992 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:04:12.123 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:04:25.252 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:04:36.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:04:36.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:04:41.382 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:04:54.588 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-02-13T05:04:54.588 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-02-13T05:05:00.515 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:05:00.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:00.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:03.644 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-02-13T05:05:03.644 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-02-13T05:05:09.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:09.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:12.700 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-02-13T05:05:12.700 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-02-13T05:05:18.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:18.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:21.757 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-02-13T05:05:21.757 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-02-13T05:05:22.606 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:05:27.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:27.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:05:47.700 ERROR:teuthology.orchestra.connection:Error authenticating with smithi204.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-13T05:06:27.760 WARNING:teuthology.provision.fog.smithi040:timed out
2024-02-13T05:06:27.761 WARNING:teuthology.provision.fog.smithi019:timed out
2024-02-13T05:06:33.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:06:33.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:06:33.996 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-13T05:06:33.997 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-13T05:06:34.087 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-13T05:06:34.087 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-13T05:06:34.172 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:06:34.340 INFO:teuthology.provision.fog.smithi040:Node is ready
2024-02-13T05:06:34.340 DEBUG:teuthology.orchestra.run.smithi040:> hostname
2024-02-13T05:06:34.355 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2024-02-13T05:06:34.355 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts
2024-02-13T05:06:34.403 INFO:teuthology.provision.fog.smithi019:Node is ready
2024-02-13T05:06:34.403 DEBUG:teuthology.orchestra.run.smithi019:> hostname
2024-02-13T05:06:34.411 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2024-02-13T05:06:34.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-02-13T05:06:34.418 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2024-02-13T05:06:34.419 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts
2024-02-13T05:06:34.474 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2024-02-13T05:06:34.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-02-13T05:06:34.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts
2024-02-13T05:06:34.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts
2024-02-13T05:06:34.580 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts
2024-02-13T05:06:34.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts
2024-02-13T05:06:34.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname
2024-02-13T05:06:34.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname
2024-02-13T05:06:34.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-02-13T05:06:34.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-02-13T05:06:34.769 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-02-13T05:06:34.822 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-02-13T05:06:34.824 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-13T05:06:34.825 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-13T05:06:34.825 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-13T05:06:34.825 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2024-02-13T05:06:34.827 DEBUG:teuthology.parallel:result is None
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2024-02-13T05:06:34.878 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-13T05:06:34.879 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-13T05:06:34.879 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-13T05:06:34.879 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2024-02-13T05:06:34.879 DEBUG:teuthology.parallel:result is None
2024-02-13T05:06:40.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:06:42.108 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:06:48.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:06:51.164 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:06:57.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:07:00.220 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-02-13T05:07:06.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:08:06.224 WARNING:teuthology.provision.fog.smithi204:timed out
2024-02-13T05:08:12.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:08:12.572 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-13T05:08:12.572 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-13T05:08:12.900 INFO:teuthology.provision.fog.smithi204:Node is ready
2024-02-13T05:08:12.900 DEBUG:teuthology.orchestra.run.smithi204:> hostname
2024-02-13T05:08:12.915 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com
2024-02-13T05:08:12.915 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts
2024-02-13T05:08:12.970 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2024-02-13T05:08:12.970 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2024-02-13T05:08:13.122 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts
2024-02-13T05:08:13.150 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts
2024-02-13T05:08:13.218 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname
2024-02-13T05:08:13.285 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2024-02-13T05:08:13.352 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31"
2024-02-13T05:08:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon"
2024-02-13T05:08:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-13T05:08:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/"
2024-02-13T05:08:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-13T05:08:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-13T05:08:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-13T05:08:13.408 INFO:teuthology.provision.fog.smithi204:Deploy complete!
2024-02-13T05:08:13.408 DEBUG:teuthology.parallel:result is None
2024-02-13T05:08:13.623 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2024-02-13T05:08:13.624 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-13T05:08:13.644 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2024-02-13T05:08:13.644 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-13T05:08:13.660 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com
2024-02-13T05:08:13.660 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-13T05:08:13.678 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2024-02-13T05:08:13.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-02-13T05:08:13.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:08:13.783 DEBUG:teuthology.orchestra.run.smithi019:> true
2024-02-13T05:08:13.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-02-13T05:08:13.966 DEBUG:teuthology.orchestra.run.smithi019:> uname -m
2024-02-13T05:08:14.021 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2024-02-13T05:08:14.021 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-02-13T05:08:14.075 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2024-02-13T05:08:14.075 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2024-02-13T05:08:14.075 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2024-02-13T05:08:14.075 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2024-02-13T05:08:14.075 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2024-02-13T05:08:14.075 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-13T05:08:14.076 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-13T05:08:14.076 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-02-13T05:08:14.094 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2024-02-13T05:08:14.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-02-13T05:08:14.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:08:14.194 DEBUG:teuthology.orchestra.run.smithi040:> true
2024-02-13T05:08:14.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-02-13T05:08:14.374 DEBUG:teuthology.orchestra.run.smithi040:> uname -m
2024-02-13T05:08:14.429 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2024-02-13T05:08:14.429 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-02-13T05:08:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-02-13T05:08:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-02-13T05:08:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-02-13T05:08:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-02-13T05:08:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-02-13T05:08:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-02-13T05:08:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-13T05:08:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-02-13T05:08:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-02-13T05:08:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-13T05:08:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-02-13T05:08:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-13T05:08:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-13T05:08:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-13T05:08:14.486 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-02-13T05:08:14.510 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server
2024-02-13T05:08:14.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2024-02-13T05:08:14.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-13T05:08:14.599 DEBUG:teuthology.orchestra.run.smithi204:> true
2024-02-13T05:08:14.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com'
2024-02-13T05:08:14.669 DEBUG:teuthology.orchestra.run.smithi204:> uname -m
2024-02-13T05:08:14.725 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64
2024-02-13T05:08:14.725 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream"
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9"
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos"
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora"
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9"
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9"
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-13T05:08:14.782 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31"
2024-02-13T05:08:14.783 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon"
2024-02-13T05:08:14.783 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-13T05:08:14.783 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/"
2024-02-13T05:08:14.783 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-13T05:08:14.783 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-13T05:08:14.783 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-13T05:08:14.783 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2024-02-13T05:08:14.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-13T05:08:14.877 INFO:teuthology.dispatcher.supervisor:Running job 7557509
2024-02-13T05:08:14.878 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-02-13_05:00:14-smoke-main-distro-default-smithi/7557509 --name teuthology-2024-02-13_05:00:14-smoke-main-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/kclient_workunit_direct_io}} -- /home/teuthworker/archive/teuthology-2024-02-13_05:00:14-smoke-main-distro-default-smithi/7557509/orig.config.yaml
2024-02-13T05:08:14.880 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-02-13_05:00:14-smoke-main-distro-default-smithi/7557509
2024-02-13T05:08:14.881 INFO:teuthology.dispatcher.supervisor:Job PID: 3922599
2024-02-13T05:08:14.881 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-13T05:10:14.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-13T05:10:14.957 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-02-13T05:10:15.070 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi204 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-02-13_05:00:14-smoke-main-distro-default-smithi/7557510