2022-01-08T18:34:53.673 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-08T18:34:53.796 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging 2022-01-08T18:34:53.797 INFO:teuthology.lock.ops:Updating [ubuntu@smithi190.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T18:34:53.797 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2022-01-08T18:34:53.817 INFO:teuthology.lock.ops:Node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging is complete 2022-01-08T18:34:53.817 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging 2022-01-08T18:34:53.818 INFO:teuthology.lock.ops:Updating [ubuntu@smithi204.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T18:34:53.818 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2022-01-08T18:34:53.837 INFO:teuthology.lock.ops:Node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging is complete 2022-01-08T18:34:54.051 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.3 2022-01-08T18:34:54.076 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.3 2022-01-08T18:34:54.421 INFO:teuthology.orchestra.console:Power off smithi204 2022-01-08T18:34:54.437 INFO:teuthology.orchestra.console:Power off smithi190 2022-01-08T18:35:02.803 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2022-01-08T18:35:02.811 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2022-01-08T18:35:02.904 INFO:teuthology.orchestra.console:Power on smithi204 2022-01-08T18:35:02.913 INFO:teuthology.orchestra.console:Power on smithi190 2022-01-08T18:35:11.279 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2022-01-08T18:35:11.326 INFO:teuthology.orchestra.console:Power on for smithi204 completed 2022-01-08T18:35:11.381 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2022-01-08T18:35:11.428 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2022-01-08T18:40:01.024 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T18:40:01.292 INFO:teuthology.provision.fog.smithi190:Node is ready 2022-01-08T18:40:01.346 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2022-01-08T18:40:01.401 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2022-01-08T18:40:01.715 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2022-01-08T18:40:16.061 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T18:40:16.374 INFO:teuthology.provision.fog.smithi204:Node is ready 2022-01-08T18:40:16.389 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2022-01-08T18:40:16.444 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2022-01-08T18:40:16.777 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2022-01-08T18:40:16.925 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2022-01-08T18:40:16.926 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T18:40:16.947 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2022-01-08T18:40:16.947 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T18:40:16.967 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2022-01-08T18:40:16.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2022-01-08T18:40:17.236 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2022-01-08T18:40:17.291 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Linux" 2022-01-08T18:40:17.291 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2022-01-08T18:40:17.291 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2022-01-08T18:40:17.292 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2022-01-08T18:40:17.292 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2022-01-08T18:40:17.292 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2022-01-08T18:40:17.292 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-08T18:40:17.293 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2022-01-08T18:40:17.293 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T18:40:17.293 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2022-01-08T18:40:17.293 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-08T18:40:17.293 INFO:teuthology.orchestra.run.smithi190.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-08T18:40:17.294 INFO:teuthology.orchestra.run.smithi190.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-08T18:40:17.295 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2022-01-08T18:40:17.315 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2022-01-08T18:40:17.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2022-01-08T18:40:17.517 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2022-01-08T18:40:17.572 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Linux" 2022-01-08T18:40:17.572 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8" 2022-01-08T18:40:17.573 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2022-01-08T18:40:17.573 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2022-01-08T18:40:17.574 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8" 2022-01-08T18:40:17.574 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2022-01-08T18:40:17.574 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-08T18:40:17.575 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2022-01-08T18:40:17.575 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T18:40:17.575 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2022-01-08T18:40:17.575 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-08T18:40:17.576 INFO:teuthology.orchestra.run.smithi204.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-08T18:40:17.576 INFO:teuthology.orchestra.run.smithi204.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-08T18:40:17.576 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2022-01-08T18:40:17.674 INFO:teuthology.dispatcher.supervisor:Running job 6603108 2022-01-08T18:40:17.674 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603108 --name yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603108/orig.config.yaml 2022-01-08T18:40:17.678 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603108 2022-01-08T18:40:17.679 INFO:teuthology.dispatcher.supervisor:Job PID: 7066 2022-01-08T18:40:17.679 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-09T06:41:12.563 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-09T06:41:12.754 INFO:teuthology.kill:Killing Pids: {7066} 2022-01-09T06:41:14.886 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-09T06:41:14.888 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-09T06:41:14.889 INFO:teuthology.misc:Compressing logs... 2022-01-09T06:41:14.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2022-01-09T06:41:15.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2022-01-09T06:41:15.199 INFO:teuthology.orchestra.run.smithi190.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T06:41:15.467 INFO:teuthology.orchestra.run.smithi204.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T06:41:15.506 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T06:41:15.506 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now 2022-01-09T06:41:15.555 INFO:teuthology.orchestra.run.smithi204.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T06:41:15.555 INFO:teuthology.orchestra.run.smithi204.stderr:tar: Error is not recoverable: exiting now 2022-01-09T06:41:15.556 INFO:teuthology.misc:Compressing logs... 2022-01-09T06:41:15.755 INFO:teuthology.misc:Compressing logs... 2022-01-09T06:41:17.432 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-mon.smithi204.log: file size changed while zipping 2022-01-09T06:41:19.622 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-09T06:41:20.733 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-09T06:41:23.120 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-09T06:41:25.016 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-09T06:41:27.770 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-09T06:41:28.192 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-09T06:41:32.228 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-mon.smithi190.log: file size changed while zipping 2022-01-09T06:41:32.470 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-09T06:41:35.707 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-09T06:41:36.498 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/bb9cdf10-70b3-11ec-8c32-001a4aab830c/ceph-mgr.smithi190.woxddd.log: file size changed while zipping 2022-01-09T06:42:07.630 INFO:teuthology.kill:No teuthology processes running 2022-01-09T06:42:08.807 INFO:teuthology.kill:Nuking machines: ['smithi190', 'smithi204'] 2022-01-09T06:42:09.820 INFO:teuthology.kill:2022-01-09 06:42:09,819.819 INFO:teuthology.nuke:targets: 2022-01-09T06:42:09.821 INFO:teuthology.kill: smithi190.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZhZs3+u+onMDyCtJ5QiXt6KX9UW66TZWrxHs1/1DBonDlnA4YLXoGo57cf0vFHsmCe2oRP0RGmAwecwtW7IbG/pN3sUfp0biVXKNIct9IBl0bFu+6NShkuJgHyYBz7c6RLTSHj+qCsCEDS+mUArQX5yvWlL/7Yl3rY0Y81XhUAq16dGNtKCxGhCR2QG4O6ceEueSB/8CEl8SGi3sDwqjz1O0/2uVxJNzI0jwcNjOtCd93b4o1RNLu7q16iLWoc4lE7Kg6SCviIfJG10vB7LhQiMhkx5guaHSLT1hr5mONAlZasQ4C9712bPbAUJHQM37HKTjbdpLr20gbTnb8BBgP5lA4161anS6MqNBP29mW/kdg5mo8/6mR+KxP1tOuOjRAMDbjaiJU3tLmStaTvyF1HcoARxIzSf9D/NihNL0vi73VVUIM552H66Vu3wdaIfGFuxnQNMTalZ8qPb5t7SpFvyJD3uzlGN3GUze+R6GZTLNhOGp2VL0XQYNWGl1mtpE= 2022-01-09T06:42:09.821 INFO:teuthology.kill: smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjMttJ5PMW8yeF3sSi3p2BsgYE07Y33uyJvK+O8vww7gghCol6ryl9xm/Bx3yiPYLQzu1T9pp4cwMVTWv20uRQX02jolOOoRzZf3r9a/P0GijCzk1BWLyRwBNhY5ZvclN+FGWAAj92Um+9x6IrSn88F8m369dt0TcVCgjCRBy1Fwu/n2rMGl2nU+JggscYrblCsv5vj1R0Km9AkKm5BA/4/M/mv7lNDP43RhrKZUtHZqcMjCTA9g0YfM3444ybZY9o/WdjS1+wutgE0xhRd2XgSG8rJ9JzxwudDVemA0lN8ffo1Co9pMJgiSe0I6DyOdi8AY0t3YrWoSzWskXA7FiWAjWu7ti6EiaQ2Vo7MkattJ0t1RPDHJuPHMwONPb8zzATxrB9EZgSD4JFrAlp+ugirNz+fCkWeNkJJLSnd7C0cai4rQU7i5GxqLa6uw1/Ynde9Spmok46eySG25BobMfre0Eptp3rQMA6q13RgxsbY5VdGTuVnAT+odnTYumJTgE= 2022-01-09T06:42:09.848 INFO:teuthology.kill:2022-01-09 06:42:09,847.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T06:42:09.851 INFO:teuthology.kill:2022-01-09 06:42:09,851.851 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T06:42:09.929 INFO:teuthology.kill:2022-01-09 06:42:09,929.929 INFO:teuthology.orchestra.console:Power off smithi204 2022-01-09T06:42:09.945 INFO:teuthology.kill:2022-01-09 06:42:09,944.944 INFO:teuthology.orchestra.console:Power off smithi190 2022-01-09T06:42:18.306 INFO:teuthology.kill:2022-01-09 06:42:18,306.306 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2022-01-09T06:42:18.312 INFO:teuthology.kill:2022-01-09 06:42:18,311.311 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2022-01-09T06:42:18.458 INFO:teuthology.kill:2022-01-09 06:42:18,457.457 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com 2022-01-09T06:42:18.460 INFO:teuthology.kill:2022-01-09 06:42:18,460.460 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2022-01-09T06:44:18.777 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-09T06:44:18.911 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_05:17:03-krbd-pacific-testing-default-smithi/6600758