2022-10-20T15:03:52.263 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-20T15:03:52.415 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2022-10-20T15:03:52.416 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2022-10-20T15:03:52.417 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-10-20T15:03:52.438 INFO:teuthology.lock.ops:Node 'smithi055.front.sepia.ceph.com' reimaging is complete 2022-10-20T15:03:52.439 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2022-10-20T15:03:52.439 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2022-10-20T15:03:52.439 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2022-10-20T15:03:52.466 INFO:teuthology.lock.ops:Node 'smithi093.front.sepia.ceph.com' reimaging is complete 2022-10-20T15:03:52.660 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of ubuntu 20.04 2022-10-20T15:03:52.675 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of ubuntu 20.04 2022-10-20T15:03:52.994 INFO:teuthology.orchestra.console:Power off smithi055 2022-10-20T15:03:53.020 INFO:teuthology.orchestra.console:Power off smithi093 2022-10-20T15:04:01.416 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2022-10-20T15:04:01.517 INFO:teuthology.orchestra.console:Power on smithi093 2022-10-20T15:04:05.514 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-10-20T15:04:05.617 INFO:teuthology.orchestra.console:Power on smithi055 2022-10-20T15:04:09.908 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2022-10-20T15:04:09.917 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2022-10-20T15:04:10.010 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2022-10-20T15:04:10.019 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2022-10-20T15:08:54.288 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-20T15:08:54.774 INFO:teuthology.provision.fog.smithi055:Node is ready 2022-10-20T15:08:54.781 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2022-10-20T15:08:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2022-10-20T15:08:55.015 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2022-10-20T15:09:06.101 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-20T15:09:06.757 INFO:teuthology.provision.fog.smithi093:Node is ready 2022-10-20T15:09:06.764 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2022-10-20T15:09:06.815 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2022-10-20T15:09:06.983 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2022-10-20T15:09:07.246 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2022-10-20T15:09:07.247 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-20T15:09:07.270 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2022-10-20T15:09:07.271 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-20T15:09:07.291 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2022-10-20T15:09:07.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-10-20T15:09:07.618 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-10-20T15:09:07.624 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2022-10-20T15:09:07.625 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-20T15:09:07.625 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2022-10-20T15:09:07.625 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2022-10-20T15:09:07.625 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-20T15:09:07.626 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="20.04" 2022-10-20T15:09:07.626 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-20T15:09:07.626 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-20T15:09:07.626 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-20T15:09:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-20T15:09:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=focal 2022-10-20T15:09:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=focal 2022-10-20T15:09:07.628 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-10-20T15:09:07.647 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2022-10-20T15:09:07.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2022-10-20T15:09:07.922 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2022-10-20T15:09:07.929 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu" 2022-10-20T15:09:07.929 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-20T15:09:07.930 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu 2022-10-20T15:09:07.930 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian 2022-10-20T15:09:07.930 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-20T15:09:07.930 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="20.04" 2022-10-20T15:09:07.931 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-20T15:09:07.931 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-20T15:09:07.931 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-20T15:09:07.931 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-20T15:09:07.931 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=focal 2022-10-20T15:09:07.932 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=focal 2022-10-20T15:09:07.932 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2022-10-20T15:09:08.040 INFO:teuthology.dispatcher.supervisor:Running job 7075392 2022-10-20T15:09:08.040 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-10-20_10:31:38-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi/7075392 --name vshankar-2022-10-20_10:31:38-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/vshankar-2022-10-20_10:31:38-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi/7075392/orig.config.yaml 2022-10-20T15:09:08.044 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-10-20_10:31:38-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi/7075392 2022-10-20T15:09:08.045 INFO:teuthology.dispatcher.supervisor:Job PID: 23307 2022-10-20T15:09:08.045 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-21T03:10:01.532 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-21T03:10:01.728 INFO:teuthology.kill:Killing Pids: {23307} 2022-10-21T03:10:03.308 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-10-21T03:10:03.309 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2022-10-21T03:10:03.309 INFO:teuthology.misc:Compressing logs... 2022-10-21T03:10:03.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-10-21T03:10:03.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2022-10-21T03:10:04.361 INFO:teuthology.misc:Compressing logs... 2022-10-21T03:10:04.792 INFO:teuthology.misc:Compressing logs... 2022-10-21T03:11:37.264 INFO:teuthology.kill:No teuthology processes running 2022-10-21T03:11:38.622 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi093'] 2022-10-21T03:11:39.832 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-21T03:11:39.833 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-21T03:11:39.833 INFO:teuthology.kill:2022-10-21 03:11:39,832.832 INFO:teuthology.nuke:targets: 2022-10-21T03:11:39.833 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR0Ey3OIM0ReXIO2e++LYD6+wdyTE4AmlrXXBOy3jvKDe+VGx4YBUXhvzzpagkAK0zOFH/dEU/tIokGSbZW2IG+P+8aHI7Wc7Maoz6wGveY9/cGF55ZHZS6qB7nXnxr03746ALefkAUj1BzzOUSxtkEGnNt0gag8LJp1fE1b74Dx3ph5qjY8Hx18cJwQrytmoBLp1TZ1mzwLV4YRxqJ17WnkCfZCHSu+L7g6vhFc16K4H7kGjJGI70I/8mskl0XB1qKtCZaxFGcOGcm6cJvRYJKDeUV7fy5Zr+xS3or/Qro3VnCh0PvWJswi9CzcmKqp9z2l3ecyxwgJ8RQfoqTD+Ld9UFgje7LXVt3P3KEd3PGAnfOqyvbnJRpuSW/ZOJuk+uavAOVi/bvAsKElDejkFjrPVw9bP1LrbUfP3NcZ+/T6ECEN0VpBg26PGgkYW7qRqTIJnTQURSS5TnixTCH3PEeJ0pd0aKkWZUEHyVCyHHlfeX2CthEixLMLfOCRtU6W8= 2022-10-21T03:11:39.834 INFO:teuthology.kill: smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo0mQXg9lmoGu5EVcY6rBqX35FgIb5RBHl7sAgOU4gwlN3IUJlmqZix8xZw7aWo4UOJfYqGSnzrjdAYXhsaOQsHc4Ohe11eYsmDU9w1PpL5UeBS4Az3L7Dv4HoF/D6hmFftHO/kZoy96uf8m0w1lOe2z4g4snuRpCHxMhKHFHP23r4UUxYsgtX7CXZzTDvk//tXci9G+3TvE3Cv5k7KlFgtxkjtsLu+qcYvzlIK0SGf/5MRAHshb78MTJxvIXlNC07dyIV/6Z9lELtTNEsdXGXcj6ZFAEEuh/8AiLxmXEuPVXxvkRnzL9g8/GAfdgFlHvkfZILN6NtExDL9dV1D+tM8/PPKyPLcvrehYZoiQKRzzRoqg6uIn1XrHygsvhGclmcNlMicRh6s24hEZxFIthjiccp6e9WnbcgYpf8pMg2KskXxMZMBC5EgYlpCrllFxsWTb4B2EplltuS+HEfYGqunnJ6dadGj8JVYVgq+RtoIJdxvowTo26hPYNnSuwPXVs= 2022-10-21T03:11:39.834 INFO:teuthology.kill:2022-10-21 03:11:39,833.833 INFO:teuthology.nuke:Checking targets against current locks 2022-10-21T03:11:39.891 INFO:teuthology.kill:2022-10-21 03:11:39,891.891 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-21T03:11:39.915 INFO:teuthology.kill:2022-10-21 03:11:39,915.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-21T03:11:39.988 INFO:teuthology.kill:2022-10-21 03:11:39,987.987 INFO:teuthology.orchestra.console:Power off smithi055 2022-10-21T03:11:40.035 INFO:teuthology.kill:2022-10-21 03:11:40,035.035 INFO:teuthology.orchestra.console:Power off smithi093 2022-10-21T03:11:48.400 INFO:teuthology.kill:2022-10-21 03:11:48,400.400 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2022-10-21T03:11:48.551 INFO:teuthology.kill:2022-10-21 03:11:48,551.551 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2022-10-21T03:11:52.487 INFO:teuthology.kill:2022-10-21 03:11:52,486.486 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-10-21T03:11:52.641 INFO:teuthology.kill:2022-10-21 03:11:52,641.641 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2022-10-21T03:13:52.960 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-21T03:13:53.071 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-10-20_14:31:28-rados-wip-yuri11-testing-2022-10-19-1648-distro-default-smithi/7075707 2022-10-21T03:13:53.071 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi093 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-10-20_14:31:28-rados-wip-yuri11-testing-2022-10-19-1648-distro-default-smithi/7075707