2022-05-31T18:12:10.553 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f 2022-05-31T18:12:10.692 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2022-05-31T18:12:10.692 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2022-05-31T18:12:10.692 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2022-05-31T18:12:10.718 INFO:teuthology.lock.ops:Node 'smithi148.front.sepia.ceph.com' reimaging is complete 2022-05-31T18:12:10.718 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2022-05-31T18:12:10.718 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2022-05-31T18:12:10.718 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-05-31T18:12:10.743 INFO:teuthology.lock.ops:Node 'smithi157.front.sepia.ceph.com' reimaging is complete 2022-05-31T18:12:10.938 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 20.04 2022-05-31T18:12:10.956 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of ubuntu 20.04 2022-05-31T18:12:11.307 INFO:teuthology.orchestra.console:Power off smithi148 2022-05-31T18:12:11.350 INFO:teuthology.orchestra.console:Power off smithi157 2022-05-31T18:12:19.717 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-05-31T18:12:19.818 INFO:teuthology.orchestra.console:Power on smithi157 2022-05-31T18:12:23.794 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2022-05-31T18:12:23.896 INFO:teuthology.orchestra.console:Power on smithi148 2022-05-31T18:12:28.154 INFO:teuthology.orchestra.console:Power on for smithi148 completed 2022-05-31T18:12:28.181 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2022-05-31T18:12:28.256 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2022-05-31T18:12:28.283 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2022-05-31T18:17:47.135 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-31T18:17:47.700 INFO:teuthology.provision.fog.smithi148:Node is ready 2022-05-31T18:17:47.706 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2022-05-31T18:17:47.714 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2022-05-31T18:17:47.915 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2022-05-31T18:18:05.301 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-31T18:18:05.796 INFO:teuthology.provision.fog.smithi157:Node is ready 2022-05-31T18:18:05.845 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2022-05-31T18:18:05.867 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2022-05-31T18:18:05.976 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2022-05-31T18:18:06.173 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2022-05-31T18:18:06.174 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-31T18:18:06.199 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2022-05-31T18:18:06.199 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-31T18:18:06.217 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2022-05-31T18:18:06.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2022-05-31T18:18:06.442 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2022-05-31T18:18:06.449 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2022-05-31T18:18:06.450 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-31T18:18:06.450 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2022-05-31T18:18:06.450 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2022-05-31T18:18:06.450 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-31T18:18:06.450 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2022-05-31T18:18:06.451 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-31T18:18:06.451 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-31T18:18:06.451 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-31T18:18:06.451 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-31T18:18:06.451 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2022-05-31T18:18:06.451 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2022-05-31T18:18:06.452 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2022-05-31T18:18:06.472 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2022-05-31T18:18:06.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-05-31T18:18:06.697 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2022-05-31T18:18:06.703 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2022-05-31T18:18:06.703 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-31T18:18:06.703 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2022-05-31T18:18:06.703 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2022-05-31T18:18:06.703 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-31T18:18:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="20.04" 2022-05-31T18:18:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-31T18:18:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-31T18:18:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-31T18:18:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-31T18:18:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=focal 2022-05-31T18:18:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=focal 2022-05-31T18:18:06.704 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-05-31T18:18:06.801 INFO:teuthology.dispatcher.supervisor:Running job 6855629 2022-05-31T18:18:06.801 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-05-31_14:46:01-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6855629 --name rishabh-2022-05-31_14:46:01-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} -- /home/teuthworker/archive/rishabh-2022-05-31_14:46:01-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6855629/orig.config.yaml 2022-05-31T18:18:06.806 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-05-31_14:46:01-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6855629 2022-05-31T18:18:06.807 INFO:teuthology.dispatcher.supervisor:Job PID: 28802 2022-05-31T18:18:06.807 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-01T00:48:38.087 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-06-01T00:48:38.271 INFO:teuthology.kill:Killing Pids: {28802} 2022-06-01T00:48:39.842 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-06-01T00:48:39.843 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-06-01T00:48:39.843 INFO:teuthology.misc:Compressing logs... 2022-06-01T00:48:39.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2022-06-01T00:48:41.341 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/teuthology/orchestra/remote.py", line 509, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi148 2022-06-01T00:48:41.407 INFO:teuthology.kill:No teuthology processes running 2022-06-01T00:48:42.962 INFO:teuthology.kill:Nuking machines: ['smithi148', 'smithi157'] 2022-06-01T00:48:44.322 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-01T00:48:44.323 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-01T00:48:44.323 INFO:teuthology.kill:2022-06-01 00:48:44,322.322 INFO:teuthology.nuke:targets: 2022-06-01T00:48:44.323 INFO:teuthology.kill: smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM2j/VVY9DbHYB6tEXwDdbQRtsbuzv69MWSI2IfUMVe8iJbI/pgH1HJWFZyMYhXURQykG+ganKr+dy0NaLA5uZ/w8HguSyKe04PE2semPz6/WysJNLfBSOfp2mv9KFeSeOz7fZ66Y/m2U7dFVYSsuOLTWRhz6+2sh1UwHd+Ic0m7sPxwExvJ5F3PIhyfeRE5WbirYuoKf3kRS5qVHhVMRplKYNuQ8ycHJmMkDA8mOGABKruIZGprCHs3AJWOl2j4AuCbBtPtnu9j4dglxv7JlVaayb6jw7fG5zKdjG5lqaTUoqWuW02IPAGJFpIS0kOqFqPT5VVu1/NQONn6wZgDy1+y9DS3JFMD6Cz0a+zXRkZeVZhc5fQT+tIiV63tprMKGpV2CsH25P6tvxiJMVt5YW6CAYu8C7tpfzrh5O+VyT00cXqy0FEhdkKk4mlYarC8XfDVWrALON9cg522XbiiK4+hCtbFjaND36hBoWZNRo87AcNqNUkEFoYUOA/8IHrS0= 2022-06-01T00:48:44.323 INFO:teuthology.kill: smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7OH65/dqKFvZbzaOIl6sq4ZDj1sp7Cw+dLl8u6yLx+KjbALjTWELUY7n+IfJ5Cx1rw/NgUBm2YCvmPAiNCobSbhDaeR6UOwRxUYcuiE+pKPefDMK4/ig7ZlvASCnVebI2Zy6L+prcX5atHTX5t+hYkUBGhd0ohiFVXJAQr+4fEOarBE/q/BYl+B0gLGdLMg4oyzrD2wgqli3Mp1xkuL7OmS7DhNb543B/nF+SjYzrFHDRc8giW/eqg5z384TdOIjFGd/yn18F6AF6fEXf0y1+oHWOmS9XMT7SsiC9ee34deBGM6oPNTkTIrQg9HLwLjcgMQAofGA7unUkponaHx3Xm3G/AuhP8or8UxOSV1SfxI3Actbv0b5DY12lVNCMvf8HSDMvV3LR9OiL/H48BiGVlRP+hW5+pcXSjap/bfyQ1t2YOkETflpyv5f59spC3+gBKA+Zopd4O71fsyNFGpjCosDMwYmqEX6fYjENmXYvmgRN67jO+1oGdFL+4r12cE8= 2022-06-01T00:48:44.369 INFO:teuthology.kill:2022-06-01 00:48:44,368.368 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-01T00:48:44.372 INFO:teuthology.kill:2022-06-01 00:48:44,372.372 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-01T00:48:44.471 INFO:teuthology.kill:2022-06-01 00:48:44,471.471 INFO:teuthology.orchestra.console:Power off smithi157 2022-06-01T00:48:44.487 INFO:teuthology.kill:2022-06-01 00:48:44,487.487 INFO:teuthology.orchestra.console:Power off smithi148 2022-06-01T00:48:56.962 INFO:teuthology.kill:2022-06-01 00:48:56,961.961 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-06-01T00:48:56.973 INFO:teuthology.kill:2022-06-01 00:48:56,972.972 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2022-06-01T00:48:57.115 INFO:teuthology.kill:2022-06-01 00:48:57,115.115 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2022-06-01T00:48:57.124 INFO:teuthology.kill:2022-06-01 00:48:57,123.123 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2022-06-01T00:50:57.557 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-06-01T00:50:57.672 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi148 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-31_21:35:41-rados-wip-yuri2-testing-2022-05-31-1300-pacific-distro-default-smithi/6856538 2022-06-01T00:50:57.672 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-31_21:35:41-rados-wip-yuri2-testing-2022-05-31-1300-pacific-distro-default-smithi/6856538