2024-03-26T07:44:53.368 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-26T07:44:53.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:44:53.545 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2b09621f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2b0a682c10>, signals=[15])
2024-03-26T07:44:53.546 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging
2024-03-26T07:44:53.546 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T07:44:53.546 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2024-03-26T07:44:53.566 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2024-03-26T07:44:53.566 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T07:44:53.566 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-03-26T07:44:53.581 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-03-26T07:44:53.582 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T07:44:53.582 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-26T07:44:53.774 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-26T07:44:53.835 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of ubuntu 22.04
2024-03-26T07:44:53.851 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-26T07:44:53.861 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-26T07:44:53.890 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of ubuntu 22.04
2024-03-26T07:44:53.899 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 22.04
2024-03-26T07:44:54.085 INFO:teuthology.orchestra.console.smithi119:Power off
2024-03-26T07:44:54.085 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T07:44:54.104 INFO:teuthology.orchestra.console.smithi001:Power off
2024-03-26T07:44:54.104 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T07:44:54.113 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-03-26T07:44:54.113 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:54.126 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2024-03-26T07:44:54.126 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:54.139 INFO:teuthology.orchestra.console.smithi104:Power off
2024-03-26T07:44:54.140 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T07:44:54.147 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-26T07:44:54.148 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2024-03-26T07:44:54.160 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2024-03-26T07:44:54.160 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:54.182 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-03-26T07:44:54.248 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-03-26T07:44:54.349 INFO:teuthology.orchestra.console.smithi119:Power on
2024-03-26T07:44:54.349 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T07:44:54.372 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-03-26T07:44:54.372 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:54.394 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-26T07:44:58.151 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:58.183 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:58.261 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2024-03-26T07:44:58.292 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-03-26T07:44:58.396 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:58.505 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-26T07:45:02.266 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:02.293 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:02.375 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-03-26T07:45:02.402 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-03-26T07:45:02.477 INFO:teuthology.orchestra.console.smithi001:Power off completed
2024-03-26T07:45:02.503 INFO:teuthology.orchestra.console.smithi104:Power off completed
2024-03-26T07:45:02.505 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:02.579 INFO:teuthology.orchestra.console.smithi001:Power on
2024-03-26T07:45:02.579 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T07:45:02.601 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On
2024-03-26T07:45:02.601 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:02.609 INFO:teuthology.orchestra.console.smithi104:Power on
2024-03-26T07:45:02.609 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T07:45:02.617 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-26T07:45:02.623 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-03-26T07:45:02.630 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2024-03-26T07:45:02.630 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:02.650 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-03-26T07:45:02.718 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-03-26T07:45:02.819 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-03-26T07:45:06.626 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:06.651 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:06.736 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-03-26T07:45:06.761 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-03-26T07:45:10.742 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:10.762 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:10.854 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2024-03-26T07:45:10.871 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-03-26T07:45:10.956 INFO:teuthology.orchestra.console.smithi001:Power on completed
2024-03-26T07:45:10.972 INFO:teuthology.orchestra.console.smithi104:Power on completed
2024-03-26T07:45:11.057 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish
2024-03-26T07:45:11.073 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2024-03-26T07:48:12.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:15.394 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-03-26T07:48:19.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:21.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:22.110 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:48:24.482 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-03-26T07:48:27.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:28.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:30.462 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:48:30.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:31.166 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:48:33.534 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-03-26T07:48:36.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:37.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:39.522 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:48:39.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:40.222 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:48:42.590 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-03-26T07:48:45.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:46.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:48.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:48.606 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:48:49.282 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:48:51.646 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-03-26T07:48:54.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:55.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:57.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:57.662 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:48:58.334 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:49:00.702 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-03-26T07:49:03.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:04.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:06.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:06.750 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:49:07.390 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:49:12.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:13.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:15.842 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:49:21.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:31.810 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:49:37.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:40.254 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:49:40.894 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:49:46.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:46.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:49.310 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:49:49.950 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:49:55.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:55.316 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:49:55.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:55.954 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:50:01.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:01.321 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:50:01.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:01.957 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:50:06.710 WARNING:teuthology.provision.fog.smithi001:timed out
2024-03-26T07:50:07.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:07.324 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:50:07.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:07.961 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:50:12.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:13.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:13.328 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:50:13.727 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-03-26T07:50:13.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:13.963 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-26T07:50:19.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:19.336 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-26T07:50:19.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:19.909 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T07:50:19.910 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T07:50:19.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:20.197 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T07:50:20.197 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T07:50:20.367 INFO:teuthology.provision.fog.smithi001:Node is ready
2024-03-26T07:50:20.367 DEBUG:teuthology.orchestra.run.smithi001:> hostname
2024-03-26T07:50:20.412 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com
2024-03-26T07:50:20.413 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts
2024-03-26T07:50:20.461 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001
2024-03-26T07:50:20.461 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2024-03-26T07:50:20.567 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts
2024-03-26T07:50:20.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts
2024-03-26T07:50:20.638 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname
2024-03-26T07:50:20.697 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2024-03-26T07:50:20.756 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Ubuntu"
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="22.04"
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_CODENAME=jammy
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:ID=ubuntu
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE=debian
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-26T07:50:20.806 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-26T07:50:20.807 INFO:teuthology.orchestra.run.smithi001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-26T07:50:20.807 INFO:teuthology.orchestra.run.smithi001.stdout:UBUNTU_CODENAME=jammy
2024-03-26T07:50:20.807 INFO:teuthology.provision.fog.smithi001:Deploy complete!
2024-03-26T07:50:20.809 DEBUG:teuthology.parallel:result is None
2024-03-26T07:50:21.129 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-03-26T07:50:21.129 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-03-26T07:50:21.177 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2024-03-26T07:50:21.177 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2024-03-26T07:50:21.225 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-03-26T07:50:21.225 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-26T07:50:21.392 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2024-03-26T07:50:21.406 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-03-26T07:50:21.464 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2024-03-26T07:50:21.517 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-26T07:50:21.570 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu"
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04"
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-26T07:50:21.616 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-26T07:50:21.617 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy
2024-03-26T07:50:21.617 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-03-26T07:50:21.617 DEBUG:teuthology.parallel:result is None
2024-03-26T07:50:25.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:25.536 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T07:50:25.536 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T07:50:25.969 INFO:teuthology.provision.fog.smithi104:Node is ready
2024-03-26T07:50:25.970 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2024-03-26T07:50:26.018 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2024-03-26T07:50:26.019 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2024-03-26T07:50:26.066 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2024-03-26T07:50:26.067 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-03-26T07:50:26.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2024-03-26T07:50:26.212 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2024-03-26T07:50:26.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2024-03-26T07:50:26.321 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-03-26T07:50:26.374 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-03-26T07:50:26.421 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-26T07:50:26.422 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy
2024-03-26T07:50:26.423 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2024-03-26T07:50:26.423 DEBUG:teuthology.parallel:result is None
2024-03-26T07:50:26.697 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com
2024-03-26T07:50:26.698 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T07:50:26.721 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2024-03-26T07:50:26.721 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T07:50:26.738 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-03-26T07:50:26.738 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T07:50:26.756 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server
2024-03-26T07:50:26.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2024-03-26T07:50:26.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:26.835 DEBUG:teuthology.orchestra.run.smithi001:> true
2024-03-26T07:50:26.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com'
2024-03-26T07:50:26.958 DEBUG:teuthology.orchestra.run.smithi001:> uname -m
2024-03-26T07:50:27.004 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64
2024-03-26T07:50:27.005 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2024-03-26T07:50:27.053 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-26T07:50:27.053 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Ubuntu"
2024-03-26T07:50:27.053 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="22.04"
2024-03-26T07:50:27.053 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-26T07:50:27.053 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_CODENAME=jammy
2024-03-26T07:50:27.053 INFO:teuthology.orchestra.run.smithi001.stdout:ID=ubuntu
2024-03-26T07:50:27.053 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE=debian
2024-03-26T07:50:27.054 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-26T07:50:27.054 INFO:teuthology.orchestra.run.smithi001.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-26T07:50:27.054 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-26T07:50:27.054 INFO:teuthology.orchestra.run.smithi001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-26T07:50:27.054 INFO:teuthology.orchestra.run.smithi001.stdout:UBUNTU_CODENAME=jammy
2024-03-26T07:50:27.054 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2024-03-26T07:50:27.081 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2024-03-26T07:50:27.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-03-26T07:50:27.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:27.160 DEBUG:teuthology.orchestra.run.smithi104:> true
2024-03-26T07:50:27.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-03-26T07:50:27.275 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2024-03-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2024-03-26T07:50:27.323 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu"
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04"
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-26T07:50:27.371 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-26T07:50:27.372 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-26T07:50:27.372 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-26T07:50:27.372 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy
2024-03-26T07:50:27.372 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-03-26T07:50:27.397 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-03-26T07:50:27.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-26T07:50:27.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:27.479 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-03-26T07:50:27.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-26T07:50:27.594 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-03-26T07:50:27.640 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-03-26T07:50:27.640 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-26T07:50:27.688 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-26T07:50:27.688 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu"
2024-03-26T07:50:27.688 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04"
2024-03-26T07:50:27.688 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-26T07:50:27.688 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy
2024-03-26T07:50:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu
2024-03-26T07:50:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian
2024-03-26T07:50:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-26T07:50:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-26T07:50:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-26T07:50:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-26T07:50:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy
2024-03-26T07:50:27.689 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-26T07:50:27.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:50:27.818 INFO:teuthology.dispatcher.supervisor:Running job 7622854
2024-03-26T07:50:27.818 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_xiubli@teuthology --archive /home/teuthworker/archive/xiubli-2024-03-26_07:35:33-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7622854 --name xiubli-2024-03-26_07:35:33-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi --description fs:fscrypt:/fscrypt-protect/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-protect}} -- /home/teuthworker/archive/xiubli-2024-03-26_07:35:33-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7622854/orig.config.yaml
2024-03-26T07:50:27.822 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/xiubli-2024-03-26_07:35:33-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7622854
2024-03-26T07:50:27.822 INFO:teuthology.dispatcher.supervisor:Job PID: 1167436
2024-03-26T07:50:27.822 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-26T07:52:27.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:54:27.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:56:28.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:58:28.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:00:28.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:02:28.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:04:28.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:06:29.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:08:29.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:10:29.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:10:29.523 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1