2024-03-21T16:20:37.801 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-21T16:20:37.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:20:37.987 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f31832bbf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f318425cc10>, signals=[15])
2024-03-21T16:20:37.988 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2024-03-21T16:20:37.988 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T16:20:37.988 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-03-21T16:20:38.004 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-03-21T16:20:38.004 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T16:20:38.004 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-21T16:20:38.029 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2024-03-21T16:20:38.029 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T16:20:38.029 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-03-21T16:20:38.108 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T16:20:38.146 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T16:20:38.149 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream
2024-03-21T16:20:38.159 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T16:20:38.191 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream
2024-03-21T16:20:38.194 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream
2024-03-21T16:20:38.447 INFO:teuthology.orchestra.console.smithi175:Power off
2024-03-21T16:20:38.447 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T16:20:38.462 INFO:teuthology.orchestra.console.smithi161:Power off
2024-03-21T16:20:38.462 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T16:20:38.472 INFO:teuthology.orchestra.console.smithi107:Power off
2024-03-21T16:20:38.472 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T16:20:38.481 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-03-21T16:20:38.481 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:38.489 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-03-21T16:20:38.489 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:38.496 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2024-03-21T16:20:38.497 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:38.504 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-03-21T16:20:38.509 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-21T16:20:38.516 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-03-21T16:20:38.605 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-03-21T16:20:38.610 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-03-21T16:20:38.616 INFO:teuthology.orchestra.console.smithi107:Power off completed
2024-03-21T16:20:38.707 INFO:teuthology.orchestra.console.smithi175:Power on
2024-03-21T16:20:38.707 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T16:20:38.714 INFO:teuthology.orchestra.console.smithi161:Power on
2024-03-21T16:20:38.714 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T16:20:38.721 INFO:teuthology.orchestra.console.smithi107:Power on
2024-03-21T16:20:38.722 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T16:20:38.729 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2024-03-21T16:20:38.729 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:38.738 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-03-21T16:20:38.738 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:38.745 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On
2024-03-21T16:20:38.746 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:38.753 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-03-21T16:20:38.761 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-21T16:20:38.766 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-03-21T16:20:42.758 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:42.765 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:42.771 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:42.867 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-03-21T16:20:42.873 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-21T16:20:42.879 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-03-21T16:20:42.980 INFO:teuthology.orchestra.console.smithi107:Power on completed
2024-03-21T16:20:43.080 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2024-03-21T16:20:46.870 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:46.877 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T16:20:46.980 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-03-21T16:20:46.985 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-21T16:20:47.081 INFO:teuthology.orchestra.console.smithi175:Power on completed
2024-03-21T16:20:47.086 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-03-21T16:20:47.182 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2024-03-21T16:20:47.186 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-03-21T16:20:47.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:20:47.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:20:50.334 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:20:56.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:20:59.422 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:21:05.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:05.694 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:21:08.478 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:21:11.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:14.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:14.754 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:21:17.534 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:21:20.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:23.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:23.838 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:21:26.590 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:21:29.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:32.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:32.894 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:21:35.650 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:21:38.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:41.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:41.950 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:21:44.734 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:21:47.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:50.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:51.010 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:21:53.790 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:21:57.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:21:59.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:22:09.950 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:22:15.582 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:22:15.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:22:19.006 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-21T16:22:21.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:22:24.642 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:22:25.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:22:25.144 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:29.275 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:30.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:22:30.779 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:34.915 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:36.376 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:42.009 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:46.514 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:52.106 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:22:59.607 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:23:05.244 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:23:15.702 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T16:23:29.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:23:32.094 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:23:38.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:23:41.150 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:23:47.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:23:50.206 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:23:56.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:23:59.266 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:24:05.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:24:08.322 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:24:14.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:24:17.406 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:24:21.248 WARNING:teuthology.provision.fog.smithi161:timed out
2024-03-21T16:24:23.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:24:26.462 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:24:27.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:24:32.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:24:34.706 WARNING:teuthology.provision.fog.smithi175:timed out
2024-03-21T16:24:40.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:24:45.599 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:24:50.974 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:24:51.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:24:54.654 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:24:56.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:00.034 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:25:00.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:03.714 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-21T16:25:06.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:09.086 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-21T16:25:09.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:10.105 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T16:25:10.106 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T16:25:12.561 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T16:25:12.561 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T16:25:15.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:15.538 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T16:25:15.538 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T16:25:22.880 INFO:teuthology.provision.fog.smithi175:Node is ready
2024-03-21T16:25:22.882 DEBUG:teuthology.orchestra.run.smithi175:> hostname
2024-03-21T16:25:22.899 INFO:teuthology.orchestra.run.smithi175.stdout:smithi046
2024-03-21T16:25:22.900 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi046 /etc/hosts
2024-03-21T16:25:22.957 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-21T16:25:22.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-03-21T16:25:23.093 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi046/smithi175/g' /etc/hosts
2024-03-21T16:25:23.124 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.46/172.21.15.175/g' /etc/hosts
2024-03-21T16:25:23.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi046/smithi175/g' /etc/hostname
2024-03-21T16:25:23.262 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-03-21T16:25:23.330 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-03-21T16:25:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon"
2024-03-21T16:25:23.386 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T16:25:23.386 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2024-03-21T16:25:23.386 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T16:25:23.386 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T16:25:23.386 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T16:25:23.386 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2024-03-21T16:25:23.388 DEBUG:teuthology.parallel:result is None
2024-03-21T16:25:25.593 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-03-21T16:25:25.593 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-03-21T16:25:25.610 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-03-21T16:25:25.610 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-03-21T16:25:25.666 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-03-21T16:25:25.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-21T16:25:25.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-03-21T16:25:25.818 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-03-21T16:25:25.887 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-03-21T16:25:25.956 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-21T16:25:26.023 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-21T16:25:26.078 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-21T16:25:26.078 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-03-21T16:25:26.078 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T16:25:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T16:25:26.079 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-03-21T16:25:26.080 DEBUG:teuthology.parallel:result is None
2024-03-21T16:25:30.841 INFO:teuthology.provision.fog.smithi107:Node is ready
2024-03-21T16:25:30.841 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2024-03-21T16:25:30.859 INFO:teuthology.orchestra.run.smithi107.stdout:smithi046
2024-03-21T16:25:30.859 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi046 /etc/hosts
2024-03-21T16:25:30.916 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-21T16:25:30.917 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-03-21T16:25:31.071 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi046/smithi107/g' /etc/hosts
2024-03-21T16:25:31.101 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.46/172.21.15.107/g' /etc/hosts
2024-03-21T16:25:31.171 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi046/smithi107/g' /etc/hostname
2024-03-21T16:25:31.240 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-03-21T16:25:31.308 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-03-21T16:25:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2024-03-21T16:25:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T16:25:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-03-21T16:25:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T16:25:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T16:25:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T16:25:31.365 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2024-03-21T16:25:31.366 DEBUG:teuthology.parallel:result is None
2024-03-21T16:25:31.577 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2024-03-21T16:25:31.578 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T16:25:31.600 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-03-21T16:25:31.601 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T16:25:31.625 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2024-03-21T16:25:31.625 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T16:25:31.643 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2024-03-21T16:25:31.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-03-21T16:25:31.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:31.732 DEBUG:teuthology.orchestra.run.smithi107:> true
2024-03-21T16:25:31.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-03-21T16:25:31.801 DEBUG:teuthology.orchestra.run.smithi107:> uname -m
2024-03-21T16:25:31.854 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2024-03-21T16:25:31.854 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-03-21T16:25:31.908 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-03-21T16:25:31.908 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2024-03-21T16:25:31.908 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-03-21T16:25:31.908 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T16:25:31.909 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T16:25:31.910 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-03-21T16:25:31.934 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-03-21T16:25:31.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-21T16:25:31.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:32.021 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-03-21T16:25:32.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-21T16:25:32.091 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-03-21T16:25:32.146 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-03-21T16:25:32.146 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-21T16:25:32.202 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-03-21T16:25:32.203 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T16:25:32.203 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-21T16:25:32.203 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T16:25:32.203 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T16:25:32.203 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T16:25:32.203 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-21T16:25:32.225 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2024-03-21T16:25:32.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2024-03-21T16:25:32.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T16:25:32.312 DEBUG:teuthology.orchestra.run.smithi175:> true
2024-03-21T16:25:32.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com'
2024-03-21T16:25:32.387 DEBUG:teuthology.orchestra.run.smithi175:> uname -m
2024-03-21T16:25:32.443 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2024-03-21T16:25:32.443 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9"
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9"
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9"
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T16:25:32.499 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-03-21T16:25:32.500 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon"
2024-03-21T16:25:32.500 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T16:25:32.500 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2024-03-21T16:25:32.500 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T16:25:32.500 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T16:25:32.500 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T16:25:32.500 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-03-21T16:25:32.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:25:32.620 INFO:teuthology.dispatcher.supervisor:Running job 7613910
2024-03-21T16:25:32.620 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613910 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613910/orig.config.yaml
2024-03-21T16:25:32.623 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613910
2024-03-21T16:25:32.623 INFO:teuthology.dispatcher.supervisor:Job PID: 1915877
2024-03-21T16:25:32.623 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-21T16:27:32.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T16:27:32.695 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-03-21T16:27:32.838 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi161 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613911
2024-03-21T16:27:32.838 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi175 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613911