2023-03-02T11:20:46.722 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8
2023-03-02T11:20:46.884 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2023-03-02T11:20:46.885 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2023-03-02T11:20:46.885 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2023-03-02T11:20:46.915 INFO:teuthology.lock.ops:Node 'smithi103.front.sepia.ceph.com' reimaging is complete
2023-03-02T11:20:46.915 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging
2023-03-02T11:20:46.916 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server
2023-03-02T11:20:46.916 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2023-03-02T11:20:46.946 INFO:teuthology.lock.ops:Node 'smithi173.front.sepia.ceph.com' reimaging is complete
2023-03-02T11:20:47.087 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of ubuntu 20.04
2023-03-02T11:20:47.105 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of ubuntu 20.04
2023-03-02T11:20:47.334 INFO:teuthology.orchestra.console:Power off smithi173
2023-03-02T11:20:47.350 INFO:teuthology.orchestra.console:Power off smithi103
2023-03-02T11:20:55.720 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2023-03-02T11:20:55.821 INFO:teuthology.orchestra.console:Power on smithi103
2023-03-02T11:20:59.824 INFO:teuthology.orchestra.console:Power off for smithi173 completed
2023-03-02T11:20:59.926 INFO:teuthology.orchestra.console:Power on smithi173
2023-03-02T11:21:00.082 INFO:teuthology.orchestra.console:Power on for smithi103 completed
2023-03-02T11:21:00.183 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2023-03-02T11:21:04.189 INFO:teuthology.orchestra.console:Power on for smithi173 completed
2023-03-02T11:21:04.290 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish
2023-03-02T11:24:53.417 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-03-02T11:25:02.501 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-03-02T11:25:04.517 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:25:11.561 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-03-02T11:25:13.577 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:25:20.645 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-03-02T11:25:22.661 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:25:29.701 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-03-02T11:25:31.717 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:25:38.757 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-03-02T11:25:40.773 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:25:49.829 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:25:58.889 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:26:07.973 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-03-02T11:26:44.793 WARNING:teuthology.provision.fog:timed out
2023-03-02T11:26:50.935 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-02T11:26:51.398 INFO:teuthology.provision.fog.smithi173:Node is ready
2023-03-02T11:26:51.404 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com
2023-03-02T11:26:51.412 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173
2023-03-02T11:26:51.553 INFO:teuthology.provision.fog.smithi173:Deploy complete!
2023-03-02T11:27:14.001 WARNING:teuthology.provision.fog:timed out
2023-03-02T11:27:20.207 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-02T11:27:20.711 INFO:teuthology.provision.fog.smithi103:Node is ready
2023-03-02T11:27:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com
2023-03-02T11:27:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103
2023-03-02T11:27:20.903 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2023-03-02T11:27:21.192 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2023-03-02T11:27:21.193 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-02T11:27:21.224 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com
2023-03-02T11:27:21.226 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2023-03-02T11:27:21.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2023-03-02T11:27:21.452 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2023-03-02T11:27:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu"
2023-03-02T11:27:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-03-02T11:27:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu
2023-03-02T11:27:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian
2023-03-02T11:27:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-03-02T11:27:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="20.04"
2023-03-02T11:27:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/"
2023-03-02T11:27:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-03-02T11:27:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-03-02T11:27:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-03-02T11:27:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=focal
2023-03-02T11:27:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=focal
2023-03-02T11:27:21.462 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2023-03-02T11:27:21.483 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server
2023-03-02T11:27:21.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2023-03-02T11:27:21.745 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64
2023-03-02T11:27:21.752 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu"
2023-03-02T11:27:21.752 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-03-02T11:27:21.752 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu
2023-03-02T11:27:21.753 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian
2023-03-02T11:27:21.753 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-03-02T11:27:21.753 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="20.04"
2023-03-02T11:27:21.753 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/"
2023-03-02T11:27:21.753 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-03-02T11:27:21.753 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-03-02T11:27:21.753 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-03-02T11:27:21.754 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=focal
2023-03-02T11:27:21.754 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=focal
2023-03-02T11:27:21.754 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2023-03-02T11:27:21.880 INFO:teuthology.dispatcher.supervisor:Running job 7191692
2023-03-02T11:27:21.881 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191692 --name vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191692/orig.config.yaml
2023-03-02T11:27:21.885 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191692
2023-03-02T11:27:21.886 INFO:teuthology.dispatcher.supervisor:Job PID: 18834
2023-03-02T11:27:21.886 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-02T23:28:19.732 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-02T23:28:19.880 INFO:teuthology.kill:Killing Pids: {18834}
2023-03-02T23:28:20.664 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2023-03-02T23:28:20.665 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2023-03-02T23:28:20.665 INFO:teuthology.misc:Compressing logs...
2023-03-02T23:28:20.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2023-03-02T23:28:21.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2023-03-02T23:28:21.691 INFO:teuthology.misc:Compressing logs...
2023-03-02T23:28:22.092 INFO:teuthology.misc:Compressing logs...
2023-03-02T23:29:04.037 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/ceph-client.0.38642.log: file size changed while zipping
2023-03-02T23:30:17.353 INFO:teuthology.kill:No teuthology processes running
2023-03-02T23:30:18.065 INFO:teuthology.kill:Nuking machines: ['smithi103', 'smithi173']
2023-03-02T23:30:18.603 INFO:teuthology.kill:2023-03-02 23:30:18,603.603 INFO:teuthology.nuke:targets:
2023-03-02T23:30:18.604 INFO:teuthology.kill:  smithi103.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw
2023-03-02T23:30:18.604 INFO:teuthology.kill:  smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=
2023-03-02T23:30:18.604 INFO:teuthology.kill:2023-03-02 23:30:18,603.603 INFO:teuthology.nuke:Checking targets against current locks
2023-03-02T23:30:18.661 INFO:teuthology.kill:2023-03-02 23:30:18,661.661 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-02T23:30:18.689 INFO:teuthology.kill:2023-03-02 23:30:18,689.689 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-02T23:30:18.734 INFO:teuthology.kill:2023-03-02 23:30:18,733.733 INFO:teuthology.orchestra.console:Power off smithi103
2023-03-02T23:30:18.773 INFO:teuthology.kill:2023-03-02 23:30:18,772.772 INFO:teuthology.orchestra.console:Power off smithi173
2023-03-02T23:30:27.110 INFO:teuthology.kill:2023-03-02 23:30:27,109.109 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2023-03-02T23:30:27.266 INFO:teuthology.kill:2023-03-02 23:30:27,266.266 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2023-03-02T23:30:31.242 INFO:teuthology.kill:2023-03-02 23:30:31,242.242 INFO:teuthology.orchestra.console:Power off for smithi173 completed
2023-03-02T23:30:31.442 INFO:teuthology.kill:2023-03-02 23:30:31,442.442 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com
2023-03-02T23:32:31.766 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15