2023-03-30T07:49:53.617 INFO:root:teuthology version: 0.0.1.dev78+ge372916
2023-03-30T07:49:53.758 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging
2023-03-30T07:49:53.759 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server
2023-03-30T07:49:53.759 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2023-03-30T07:49:53.781 INFO:teuthology.lock.ops:Node 'smithi087.front.sepia.ceph.com' reimaging is complete
2023-03-30T07:49:53.781 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2023-03-30T07:49:53.782 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2023-03-30T07:49:53.782 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-03-30T07:49:53.806 INFO:teuthology.lock.ops:Node 'smithi115.front.sepia.ceph.com' reimaging is complete
2023-03-30T07:49:53.942 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of ubuntu 20.04
2023-03-30T07:49:53.954 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of ubuntu 20.04
2023-03-30T07:49:54.205 INFO:teuthology.orchestra.console:Power off smithi115
2023-03-30T07:49:54.222 INFO:teuthology.orchestra.console:Power off smithi087
2023-03-30T07:49:54.362 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2023-03-30T07:49:54.464 INFO:teuthology.orchestra.console:Power on smithi087
2023-03-30T07:50:02.582 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2023-03-30T07:50:02.683 INFO:teuthology.orchestra.console:Power on smithi115
2023-03-30T07:50:02.829 INFO:teuthology.orchestra.console:Power on for smithi087 completed
2023-03-30T07:50:02.930 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish
2023-03-30T07:50:11.050 INFO:teuthology.orchestra.console:Power on for smithi115 completed
2023-03-30T07:50:11.152 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2023-03-30T07:53:51.877 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-03-30T07:54:00.133 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-03-30T07:54:00.933 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-03-30T07:54:09.189 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-03-30T07:54:09.989 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-03-30T07:54:18.245 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-03-30T07:54:19.045 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-03-30T07:54:27.301 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-03-30T07:54:28.101 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-03-30T07:54:36.357 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-03-30T07:54:37.161 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-03-30T07:54:45.445 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-03-30T07:55:43.217 WARNING:teuthology.provision.fog:timed out
2023-03-30T07:55:49.365 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-30T07:55:49.863 INFO:teuthology.provision.fog.smithi087:Node is ready
2023-03-30T07:55:49.909 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com
2023-03-30T07:55:49.916 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087
2023-03-30T07:55:50.044 INFO:teuthology.provision.fog.smithi087:Deploy complete!
2023-03-30T07:55:51.453 WARNING:teuthology.provision.fog:timed out
2023-03-30T07:55:57.669 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-30T07:55:58.142 INFO:teuthology.provision.fog.smithi115:Node is ready
2023-03-30T07:55:58.149 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2023-03-30T07:55:58.197 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2023-03-30T07:55:58.335 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2023-03-30T07:55:58.571 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com
2023-03-30T07:55:58.572 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-30T07:55:58.594 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2023-03-30T07:55:58.594 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-30T07:55:58.620 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server
2023-03-30T07:55:58.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2023-03-30T07:55:58.792 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64
2023-03-30T07:55:58.799 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu"
2023-03-30T07:55:58.799 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-03-30T07:55:58.799 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu
2023-03-30T07:55:58.800 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian
2023-03-30T07:55:58.800 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-03-30T07:55:58.800 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04"
2023-03-30T07:55:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/"
2023-03-30T07:55:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-03-30T07:55:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-03-30T07:55:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-03-30T07:55:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal
2023-03-30T07:55:58.802 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal
2023-03-30T07:55:58.802 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2023-03-30T07:55:58.828 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2023-03-30T07:55:58.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-03-30T07:55:59.046 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2023-03-30T07:55:59.053 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu"
2023-03-30T07:55:59.053 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-03-30T07:55:59.053 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu
2023-03-30T07:55:59.053 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian
2023-03-30T07:55:59.054 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-03-30T07:55:59.054 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="20.04"
2023-03-30T07:55:59.054 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/"
2023-03-30T07:55:59.054 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-03-30T07:55:59.054 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-03-30T07:55:59.054 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-03-30T07:55:59.054 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=focal
2023-03-30T07:55:59.055 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=focal
2023-03-30T07:55:59.055 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-03-30T07:55:59.161 INFO:teuthology.dispatcher.supervisor:Running job 7225993
2023-03-30T07:55:59.161 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e3729161eecf8e6d09a4069acbb883cdcd5e9f50/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993 --name vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/orig.config.yaml
2023-03-30T07:55:59.165 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993
2023-03-30T07:55:59.166 INFO:teuthology.dispatcher.supervisor:Job PID: 7133
2023-03-30T07:55:59.166 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-30T19:56:57.505 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-30T19:56:57.644 INFO:teuthology.kill:Killing Pids: {7133}
2023-03-30T19:57:05.567 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2023-03-30T19:57:05.567 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2023-03-30T19:57:05.568 INFO:teuthology.misc:Compressing logs...
2023-03-30T19:57:05.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2023-03-30T19:57:06.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-03-30T19:57:07.022 INFO:teuthology.misc:Compressing logs...
2023-03-30T19:57:07.316 INFO:teuthology.misc:Compressing logs...
2023-03-30T21:19:14.417 INFO:teuthology.kill:No teuthology processes running
2023-03-30T21:19:21.684 INFO:teuthology.kill:Nuking machines: ['smithi087', 'smithi115']
2023-03-30T21:19:22.380 INFO:teuthology.kill:2023-03-30 21:19:22,380.380 INFO:teuthology.nuke:targets:
2023-03-30T21:19:22.382 INFO:teuthology.kill:  smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=
2023-03-30T21:19:22.382 INFO:teuthology.kill:  smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=
2023-03-30T21:19:22.382 INFO:teuthology.kill:2023-03-30 21:19:22,380.380 INFO:teuthology.nuke:Checking targets against current locks
2023-03-30T21:19:22.438 INFO:teuthology.kill:2023-03-30 21:19:22,437.437 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-30T21:19:22.467 INFO:teuthology.kill:2023-03-30 21:19:22,467.467 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-30T21:19:22.527 INFO:teuthology.kill:2023-03-30 21:19:22,527.527 INFO:teuthology.orchestra.console:Power off smithi087
2023-03-30T21:19:22.547 INFO:teuthology.kill:2023-03-30 21:19:22,546.546 INFO:teuthology.orchestra.console:Power off smithi115
2023-03-30T21:19:30.918 INFO:teuthology.kill:2023-03-30 21:19:30,918.918 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2023-03-30T21:19:31.081 INFO:teuthology.kill:2023-03-30 21:19:31,080.080 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com
2023-03-30T21:19:35.025 INFO:teuthology.kill:2023-03-30 21:19:35,024.024 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2023-03-30T21:19:35.181 INFO:teuthology.kill:2023-03-30 21:19:35,180.180 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com
2023-03-30T21:21:35.556 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-30T21:21:35.666 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi087 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-03-30_19:16:48-fs-wip-pdonnell-testing-20230330.161229-quincy-distro-default-smithi/7227043
2023-03-30T21:21:35.666 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi115 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-03-30_19:16:48-fs-wip-pdonnell-testing-20230330.161229-quincy-distro-default-smithi/7227043