2022-01-13T17:18:27.671 INFO:root:teuthology version: 1.1.0-6fc20113 2022-01-13T17:18:27.798 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging 2022-01-13T17:18:27.799 INFO:teuthology.lock.ops:Updating [ubuntu@smithi077.front.sepia.ceph.com]: reset os type and version on server 2022-01-13T17:18:27.799 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2022-01-13T17:18:27.818 INFO:teuthology.lock.ops:Node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging is complete 2022-01-13T17:18:27.819 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging 2022-01-13T17:18:27.819 INFO:teuthology.lock.ops:Updating [ubuntu@smithi079.front.sepia.ceph.com]: reset os type and version on server 2022-01-13T17:18:27.819 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-01-13T17:18:27.838 INFO:teuthology.lock.ops:Node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging is complete 2022-01-13T17:18:28.048 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 8.2 2022-01-13T17:18:28.059 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.2 2022-01-13T17:18:28.407 INFO:teuthology.orchestra.console:Power off smithi079 2022-01-13T17:18:28.425 INFO:teuthology.orchestra.console:Power off smithi077 2022-01-13T17:18:36.798 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2022-01-13T17:18:36.900 INFO:teuthology.orchestra.console:Power on smithi077 2022-01-13T17:18:40.896 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-01-13T17:18:40.998 INFO:teuthology.orchestra.console:Power on smithi079 2022-01-13T17:18:41.152 INFO:teuthology.orchestra.console:Power on for smithi077 completed 2022-01-13T17:18:41.253 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2022-01-13T17:18:45.252 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2022-01-13T17:18:45.353 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2022-01-13T17:22:53.185 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-13T17:23:08.558 INFO:teuthology.provision.fog.smithi077:Node is ready 2022-01-13T17:23:08.616 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2022-01-13T17:23:08.672 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2022-01-13T17:23:09.032 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2022-01-13T17:23:49.844 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-13T17:23:50.145 INFO:teuthology.provision.fog.smithi079:Node is ready 2022-01-13T17:23:50.200 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2022-01-13T17:23:50.256 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2022-01-13T17:23:50.589 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2022-01-13T17:23:50.739 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2022-01-13T17:23:50.740 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-13T17:23:50.761 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2022-01-13T17:23:50.762 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-13T17:23:50.780 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2022-01-13T17:23:50.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2022-01-13T17:23:51.047 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2022-01-13T17:23:51.102 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Linux" 2022-01-13T17:23:51.102 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8 (Core)" 2022-01-13T17:23:51.102 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2022-01-13T17:23:51.103 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2022-01-13T17:23:51.103 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8" 2022-01-13T17:23:51.103 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2022-01-13T17:23:51.104 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-13T17:23:51.104 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2022-01-13T17:23:51.104 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-13T17:23:51.104 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.centos.org/" 2022-01-13T17:23:51.105 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-13T17:23:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2022-01-13T17:23:51.105 INFO:teuthology.orchestra.run.smithi077.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-13T17:23:51.105 INFO:teuthology.orchestra.run.smithi077.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-13T17:23:51.106 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-13T17:23:51.106 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-13T17:23:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: 2022-01-13T17:23:51.107 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2022-01-13T17:23:51.126 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2022-01-13T17:23:51.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-01-13T17:23:51.332 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2022-01-13T17:23:51.386 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Linux" 2022-01-13T17:23:51.386 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8 (Core)" 2022-01-13T17:23:51.386 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2022-01-13T17:23:51.386 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2022-01-13T17:23:51.387 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2022-01-13T17:23:51.387 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2022-01-13T17:23:51.387 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-13T17:23:51.387 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2022-01-13T17:23:51.388 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-13T17:23:51.388 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.centos.org/" 2022-01-13T17:23:51.388 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-13T17:23:51.388 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-01-13T17:23:51.388 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-13T17:23:51.389 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-13T17:23:51.389 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-13T17:23:51.389 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-13T17:23:51.389 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-01-13T17:23:51.390 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-01-13T17:23:51.482 INFO:teuthology.dispatcher.supervisor:Running job 6612877 2022-01-13T17:23:51.482 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-13_14:57:55-rados-wip-yuri5-testing-2022-01-12-1534-distro-default-smithi/6612877 --name yuriw-2022-01-13_14:57:55-rados-wip-yuri5-testing-2022-01-12-1534-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-13_14:57:55-rados-wip-yuri5-testing-2022-01-12-1534-distro-default-smithi/6612877/orig.config.yaml 2022-01-13T17:23:51.486 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-13_14:57:55-rados-wip-yuri5-testing-2022-01-12-1534-distro-default-smithi/6612877 2022-01-13T17:23:51.487 INFO:teuthology.dispatcher.supervisor:Job PID: 27276 2022-01-13T17:23:51.488 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-14T05:24:46.371 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-14T05:24:46.541 INFO:teuthology.kill:Killing Pids: {27276} 2022-01-14T05:24:47.754 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-14T05:24:47.755 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-14T05:24:47.755 INFO:teuthology.misc:Compressing logs... 2022-01-14T05:24:47.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2022-01-14T05:24:47.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-01-14T05:24:48.006 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-14T05:24:48.268 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-14T05:24:48.394 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-14T05:24:48.394 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2022-01-14T05:24:48.427 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-14T05:24:48.428 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2022-01-14T05:24:48.429 INFO:teuthology.misc:Compressing logs... 2022-01-14T05:24:48.652 INFO:teuthology.misc:Compressing logs... 2022-01-14T05:24:50.542 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-14T05:24:51.041 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-14T05:24:52.432 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-14T05:24:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-14T05:24:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-mgr.smithi077.uhxlha.log: file size changed while zipping 2022-01-14T05:24:53.722 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-mon.smithi079.log: file size changed while zipping 2022-01-14T05:24:55.243 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-mon.smithi077.log: file size changed while zipping 2022-01-14T05:24:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-14T05:24:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-14T05:24:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-14T05:24:59.876 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/f6371014-7496-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-14T05:25:31.128 INFO:teuthology.kill:No teuthology processes running 2022-01-14T05:25:32.234 INFO:teuthology.kill:Nuking machines: ['smithi077', 'smithi079'] 2022-01-14T05:25:33.174 INFO:teuthology.kill:2022-01-14 05:25:33,174.174 INFO:teuthology.nuke:targets: 2022-01-14T05:25:33.176 INFO:teuthology.kill: smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8kLXfX6VkIPDqr4SXwuHBbR8f0abBOCt8eJXiVL3Aqw4UiKFoKWitFRoYNufNExqRgWcuKqpqRqyW2dSk2zSgrIOc3oKQj+lwnwQUmxhi+NtzBS1eWsY+jAyYQpK4uhN1kCMmhHfYXS6jGayMURHC27fy2svxLlM7XhsaJgTivoSIXFu5hshZZqB/Ajch5owF7hgoX1hqHloc7utsC61MWUcohIFx1fF7mrU9zAtBpZ2cJC+fSMumd41x7fPnA2rT2oWu9n2UpfVFOubrSQURmbMBvujRZZ36uBuYvci7mIrKkR4NZQ84a/Lg+urDnvv/gwAkVRwfyhrMU8oOkhQGhOQ/zHy1Q938ecWUrIGBA9oXTk7EudjU1GVWDYQh00IqMvcOqWlPiS9zrtvmE5hL9TpDl/mmYhg4mpShIAAIbaqcdWuYu452AXYx5U1d2LGCTbw/EQDz8ZkLeqAjaRpl9ii533XVkN/pOnqBjwaGDC3tJz+ymxZsiSkYG9tXmLc= 2022-01-14T05:25:33.176 INFO:teuthology.kill: smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq3iv5DVNRzPd1SyE7S9o+31plyyKqGXDeKgXO2lR1CJZBBqxxW//wa2u5ohXx0Nlj0O1VNib8quj4C7xMHbRwwvpwzoX7LnYlJgKK7/NyXE9RDE/ZmScqK1oK3M8fvvKqjWnCiTLjlx0E0nubfWKAeJnzW9RO2qU/rj3IoFHDPwmiT+8tHMImhtjiYbmlV+l9v0lo4CX8EklnzpH0OxOQsnEeLAqXDoKO5/dn2ZKPzgvN/txzu6i534QmZPtgPjWrpofmyFIFsjgyMotAuy8RqzxGsVHcs5tesx8RkATtIrsyCRvnfSvzVzwSK37iKQ+qdHaAOtjeEtyKhy0YQVlUc9QzWeYtDiamE4a0pXh1EMXwIV1x5fwqI7ncBfP4zmI7Euttq8OBC3rRNn+JZdbvUTZZp5qbMI4fNwh6pZEO2rRWD/syXsrHmXI+eP7zeM87eb1VqYfaXUHWO0K1GU7xskn7HcOMMpOilpEiYQfQBvH3rzbUKqlUysnWCG0LRhc= 2022-01-14T05:25:33.202 INFO:teuthology.kill:2022-01-14 05:25:33,202.202 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-14T05:25:33.203 INFO:teuthology.kill:2022-01-14 05:25:33,203.203 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-14T05:25:33.282 INFO:teuthology.kill:2022-01-14 05:25:33,282.282 INFO:teuthology.orchestra.console:Power off smithi077 2022-01-14T05:25:33.294 INFO:teuthology.kill:2022-01-14 05:25:33,294.294 INFO:teuthology.orchestra.console:Power off smithi079 2022-01-14T05:25:45.765 INFO:teuthology.kill:2022-01-14 05:25:45,765.765 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2022-01-14T05:25:45.769 INFO:teuthology.kill:2022-01-14 05:25:45,768.768 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-01-14T05:25:45.916 INFO:teuthology.kill:2022-01-14 05:25:45,915.915 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com 2022-01-14T05:25:45.919 INFO:teuthology.kill:2022-01-14 05:25:45,919.919 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2022-01-14T05:27:46.217 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-14T05:27:46.311 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-01-13_21:58:36-rgw-wip-cbodley-testing-distro-default-smithi/6614838 2022-01-14T05:27:46.312 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi079 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-01-13_21:58:36-rgw-wip-cbodley-testing-distro-default-smithi/6614838