2022-07-27T10:33:27.108 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-27T10:33:27.518 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2022-07-27T10:33:27.528 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2022-07-27T10:33:27.529 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2022-07-27T10:33:27.583 INFO:teuthology.lock.ops:Node 'smithi104.front.sepia.ceph.com' reimaging is complete 2022-07-27T10:33:27.583 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2022-07-27T10:33:27.585 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2022-07-27T10:33:27.586 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-07-27T10:33:27.680 INFO:teuthology.lock.ops:Node 'smithi105.front.sepia.ceph.com' reimaging is complete 2022-07-27T10:33:27.911 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 20.04 2022-07-27T10:33:27.989 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of ubuntu 20.04 2022-07-27T10:33:28.566 INFO:teuthology.orchestra.console:Power off smithi104 2022-07-27T10:33:28.676 INFO:teuthology.orchestra.console:Power off smithi105 2022-07-27T10:33:28.894 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-07-27T10:33:28.895 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2022-07-27T10:33:28.996 INFO:teuthology.orchestra.console:Power on smithi105 2022-07-27T10:33:29.064 INFO:teuthology.orchestra.console:Power on smithi104 2022-07-27T10:33:37.532 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2022-07-27T10:33:37.646 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2022-07-27T10:33:37.671 INFO:teuthology.orchestra.console:Power on for smithi104 completed 2022-07-27T10:33:37.791 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2022-07-27T10:38:35.693 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-27T10:38:35.698 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-27T10:38:36.213 INFO:teuthology.provision.fog.smithi104:Node is ready 2022-07-27T10:38:36.220 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2022-07-27T10:38:36.228 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2022-07-27T10:38:36.248 INFO:teuthology.provision.fog.smithi105:Node is ready 2022-07-27T10:38:36.296 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2022-07-27T10:38:36.304 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2022-07-27T10:38:36.456 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2022-07-27T10:38:36.487 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2022-07-27T10:38:36.729 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2022-07-27T10:38:36.730 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-27T10:38:36.757 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2022-07-27T10:38:36.757 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-27T10:38:36.784 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2022-07-27T10:38:36.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2022-07-27T10:38:37.029 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2022-07-27T10:38:37.035 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2022-07-27T10:38:37.036 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-07-27T10:38:37.036 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2022-07-27T10:38:37.037 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2022-07-27T10:38:37.037 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-07-27T10:38:37.037 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="20.04" 2022-07-27T10:38:37.037 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-27T10:38:37.037 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-27T10:38:37.038 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-27T10:38:37.038 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-27T10:38:37.038 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=focal 2022-07-27T10:38:37.039 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=focal 2022-07-27T10:38:37.040 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2022-07-27T10:38:37.069 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2022-07-27T10:38:37.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-07-27T10:38:37.348 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2022-07-27T10:38:37.358 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu" 2022-07-27T10:38:37.359 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-07-27T10:38:37.359 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu 2022-07-27T10:38:37.359 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian 2022-07-27T10:38:37.359 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-07-27T10:38:37.360 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="20.04" 2022-07-27T10:38:37.360 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-27T10:38:37.361 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-27T10:38:37.361 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-27T10:38:37.361 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-27T10:38:37.362 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=focal 2022-07-27T10:38:37.362 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=focal 2022-07-27T10:38:37.362 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-07-27T10:38:37.491 INFO:teuthology.dispatcher.supervisor:Running job 6949807 2022-07-27T10:38:37.492 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949807 --name gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi --description orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} -- /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949807/orig.config.yaml 2022-07-27T10:38:37.497 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949807 2022-07-27T10:38:37.498 INFO:teuthology.dispatcher.supervisor:Job PID: 30461 2022-07-27T10:38:37.498 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-27T22:39:36.205 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-27T22:39:36.865 INFO:teuthology.kill:Killing Pids: {30461} 2022-07-27T22:39:47.281 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-07-27T22:39:47.308 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-07-27T22:39:47.309 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:39:47.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2022-07-27T22:39:48.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-07-27T22:39:48.169 INFO:teuthology.orchestra.run.smithi104.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-07-27T22:39:48.941 INFO:teuthology.orchestra.run.smithi105.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-07-27T22:39:49.118 INFO:teuthology.orchestra.run.smithi104.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-07-27T22:39:49.119 INFO:teuthology.orchestra.run.smithi104.stderr:tar: Error is not recoverable: exiting now 2022-07-27T22:39:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-07-27T22:39:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:tar: Error is not recoverable: exiting now 2022-07-27T22:39:49.162 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:39:49.881 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:39:53.691 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-07-27T22:39:54.105 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-27T22:39:57.810 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-07-27T22:39:57.851 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-07-27T22:40:01.574 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-27T22:40:01.691 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-07-27T22:40:03.929 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-mon.smithi105.log: file size changed while zipping 2022-07-27T22:40:06.178 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-07-27T22:40:07.652 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-27T22:40:09.521 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/562e8f1a-0d99-11ed-8430-001a4aab830c/ceph-mon.smithi104.log: file size changed while zipping 2022-07-27T22:41:09.845 INFO:teuthology.kill:No teuthology processes running 2022-07-27T22:41:15.549 INFO:teuthology.kill:Nuking machines: ['smithi104', 'smithi105'] 2022-07-27T22:41:22.210 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-27T22:41:22.211 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-27T22:41:22.212 INFO:teuthology.kill:2022-07-27 22:41:22,202.202 INFO:teuthology.nuke:targets: 2022-07-27T22:41:22.212 INFO:teuthology.kill: smithi104.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZlUxIAO/U5HAx86dw6l9Kn98RQdQQUPczj9saHtXWWyxMGdCtD9TP4dlkUuoev8wNo+TLX2eNDS17r5pfCtpMLo9/EZJcD3fhAzKh4mOkDKEiTwxqCTiB4j/yjkuxiE9NSidIXsE2lAz9obF+Yh+oLBHetRruxZz9AmDZKlkngVadz9OEN4SfI9Ls2DrReypcLJnr3xtZus8ibCLXHSqn8Go+p9osv2+x9VcwOj36d+z7TVJR7NGVwUr4WubzW8IrYpQnI3A2gFeB9CMBkQDlEJ6MfjtMY8K/WV65iTan0KK2j7or+zP56Qo01W6atOVeQBaQ9qQ31Ixw365qxs46eXExXjX6QZDNwsuhSyUDGKIc0aVykhjFw4GbH2rWCGNqvqK/N7qFciaYTkf73Yvxn4diSP+L3lw1zXwzxed93Du0B8grC8jgfcFLRreVz9b28FReG2vE9utCBRLtGLiIaGiMcsFBwnFo/FMIpLQECb1rzGPFLvVGsvPU9RTnDTU= 2022-07-27T22:41:22.215 INFO:teuthology.kill: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwr5n5BtkA41PywChSAzGEYxdGkCyUj01LQGVvPWkraFn6iZTPN3T/4eWBBnMk/QfSBjRuS7fzy2pfKMMWtDhWOwjd9Igqq3ulf3wnxKk4OwGB6VIHzwGIBtDRGq+8SmhVWrTcOenBz4CF4zGpfZNXdwTe24OGpG5UEsk9U/aqa0RMCvLNlSqsWO3aiQQwHl9CMokN6w9x+mDGim+h8WVPxWW2PVQveQbqkO8era/6c+E9HGG9AKsmsjQJ1UnPNV4PmVS7ogrlV0ki4jy2oXVyBli8PCX7Tl+yvCz8+3F++Lnel5gOdnuUzzlVKzJ+yr78EZao6+Vtmw+FIlx3u8EfR/KcJ7/IEi+dCMB5hApKgrDfionSiFnUM25Ti0fqz+mip3w4LpTrq8A/ZL5QYW1xoNOZvzdZo7DY7WUaMd3CvpuN9+ttdAD2l9vU3TBMR+x6Iq2RwzbLSnw9RLhKSpMf6lQPGXhG0d8wnn0HmD4ucrWBGlAoFs3MdYw2M5cc/Bc= 2022-07-27T22:41:22.216 INFO:teuthology.kill:2022-07-27 22:41:22,203.203 INFO:teuthology.nuke:Checking targets against current locks 2022-07-27T22:41:22.294 INFO:teuthology.kill:2022-07-27 22:41:22,294.294 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T22:41:22.332 INFO:teuthology.kill:2022-07-27 22:41:22,332.332 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T22:41:22.555 INFO:teuthology.kill:2022-07-27 22:41:22,554.554 INFO:teuthology.orchestra.console:Power off smithi104 2022-07-27T22:41:22.720 INFO:teuthology.kill:2022-07-27 22:41:22,720.720 INFO:teuthology.orchestra.console:Power off smithi105 2022-07-27T22:41:31.177 INFO:teuthology.kill:2022-07-27 22:41:31,176.176 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2022-07-27T22:41:31.258 INFO:teuthology.kill:2022-07-27 22:41:31,253.253 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-07-27T22:41:31.378 INFO:teuthology.kill:2022-07-27 22:41:31,377.377 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2022-07-27T22:41:31.447 INFO:teuthology.kill:2022-07-27 22:41:31,442.442 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2022-07-27T22:43:32.614 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-27T22:43:33.135 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi104 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_18:30:47-rados-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6950448 2022-07-27T22:43:33.136 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_18:30:47-rados-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6950448