2022-01-08T20:46:13.112 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-08T20:46:13.291 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging 2022-01-08T20:46:13.292 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T20:46:13.293 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-01-08T20:46:13.312 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete 2022-01-08T20:46:13.312 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging 2022-01-08T20:46:13.313 INFO:teuthology.lock.ops:Updating [ubuntu@smithi099.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T20:46:13.313 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2022-01-08T20:46:13.333 INFO:teuthology.lock.ops:Node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging is complete 2022-01-08T20:46:13.525 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream 2022-01-08T20:46:13.570 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2022-01-08T20:46:13.869 INFO:teuthology.orchestra.console:Power off smithi029 2022-01-08T20:46:14.028 INFO:teuthology.orchestra.console:Power off smithi099 2022-01-08T20:46:22.251 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-01-08T20:46:22.353 INFO:teuthology.orchestra.console:Power on smithi029 2022-01-08T20:46:26.514 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2022-01-08T20:46:26.615 INFO:teuthology.orchestra.console:Power on smithi099 2022-01-08T20:46:30.727 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2022-01-08T20:46:30.828 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2022-01-08T20:46:35.020 INFO:teuthology.orchestra.console:Power on for smithi099 completed 2022-01-08T20:46:35.121 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2022-01-08T20:51:24.745 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T20:51:25.009 INFO:teuthology.provision.fog.smithi099:Node is ready 2022-01-08T20:51:25.027 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2022-01-08T20:51:25.084 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2022-01-08T20:51:25.427 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2022-01-08T20:51:35.573 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T20:51:35.943 INFO:teuthology.provision.fog.smithi029:Node is ready 2022-01-08T20:51:35.961 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2022-01-08T20:51:36.018 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2022-01-08T20:51:36.390 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2022-01-08T20:51:36.609 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2022-01-08T20:51:36.611 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T20:51:36.634 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2022-01-08T20:51:36.635 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T20:51:36.653 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2022-01-08T20:51:36.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-01-08T20:51:36.848 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2022-01-08T20:51:36.905 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2022-01-08T20:51:36.906 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2022-01-08T20:51:36.906 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2022-01-08T20:51:36.906 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2022-01-08T20:51:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2022-01-08T20:51:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2022-01-08T20:51:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-08T20:51:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2022-01-08T20:51:36.908 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T20:51:36.908 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2022-01-08T20:51:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-08T20:51:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-08T20:51:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-08T20:51:36.911 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-01-08T20:51:36.932 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2022-01-08T20:51:36.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2022-01-08T20:51:37.174 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2022-01-08T20:51:37.229 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2022-01-08T20:51:37.230 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2022-01-08T20:51:37.230 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2022-01-08T20:51:37.230 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2022-01-08T20:51:37.231 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2022-01-08T20:51:37.231 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2022-01-08T20:51:37.231 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-08T20:51:37.232 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2022-01-08T20:51:37.232 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T20:51:37.233 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2022-01-08T20:51:37.233 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-08T20:51:37.233 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-08T20:51:37.233 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-08T20:51:37.235 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2022-01-08T20:51:37.332 INFO:teuthology.dispatcher.supervisor:Running job 6603344 2022-01-08T20:51:37.333 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603344 --name yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603344/orig.config.yaml 2022-01-08T20:51:37.337 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603344 2022-01-08T20:51:37.337 INFO:teuthology.dispatcher.supervisor:Job PID: 20212 2022-01-08T20:51:37.338 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-09T08:52:31.774 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-09T08:52:31.988 INFO:teuthology.kill:Killing Pids: {20212} 2022-01-09T08:52:33.239 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-09T08:52:33.240 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-09T08:52:33.240 INFO:teuthology.misc:Compressing logs... 2022-01-09T08:52:33.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-01-09T08:52:33.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2022-01-09T08:52:33.459 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T08:52:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T08:52:33.699 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T08:52:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now 2022-01-09T08:52:33.746 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T08:52:33.747 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2022-01-09T08:52:33.748 INFO:teuthology.misc:Compressing logs... 2022-01-09T08:52:34.249 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-01-09T08:52:34.450 INFO:teuthology.misc:Compressing logs... 2022-01-09T08:52:37.436 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-mon.smithi099.log: file size changed while zipping 2022-01-09T08:52:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-09T08:52:51.872 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-09T08:53:06.547 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-09T08:53:07.170 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-09T08:53:21.687 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-09T08:53:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-09T08:53:28.445 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-mgr.smithi029.kseyia.log: file size changed while zipping 2022-01-09T08:53:30.913 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-09T08:53:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-mon.smithi029.log: file size changed while zipping 2022-01-09T08:53:52.435 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/fd3e29a8-70c5-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-09T08:54:26.197 INFO:teuthology.orchestra.run.smithi029.stderr:tar: .: file changed as we read it 2022-01-09T08:54:52.525 INFO:teuthology.kill:No teuthology processes running 2022-01-09T08:54:53.728 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi099'] 2022-01-09T08:54:54.726 INFO:teuthology.kill:2022-01-09 08:54:54,725.725 INFO:teuthology.nuke:targets: 2022-01-09T08:54:54.727 INFO:teuthology.kill: smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7iKeUbhU879DiXdxM3UAvxRbwDNV6mA/G0NT1X1RromaPKuUI22mlNEv5LLM1jnZPth8Bl+dtLjQlutcUCa0/LhdStaYrEM2KK1LjPqbx0Ec1km8GGXenEBMi3SxYJvwmPxM6g5AXuellysTTxTzfFuKDhBSDrrDOOzuBMj5WD5Y1kcrHiglxzMamxhbOa53MZ1QvWY8zr9JOftHw6CLhT4VOTmUVr7qCFnoYCYkT1NUJWRCR+YiGmiZM6C+NwW7H6g42Eu4mWSNPxAKdaaKh8ef26tpXI9lH8tHahaC+OMUO/n3g0cMN357qaawHIdjkdzc7ei22jQ7aEVxSSujRZZs9hQmGmrlkMNhv6sBclS3eRYHKZGXa9xQsnEbqcUwBGAALr2ZvfgUf3r+BlcnPV2ahlsVAcxmO+roVjsj0mvf6tZ1dzlcYXJTd1t951CmQnSwkBfg0ezAefKDWkB2JslWhtWsps19PV0VaOvc9OiOwsWzcruulhOKHvEJkkAU= 2022-01-09T08:54:54.728 INFO:teuthology.kill: smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnLrTl757Lysc+TEl86uLgFeSCOPZVSvKHgM/qvs4jVhNVCaxJ69QgEQb0f6uOoite0xOad/XlrU5Tfks6pPPfHaaRaOcxG78kKlNo6rtKIX60l+pZskBuUVekWiLQhOZCl5yCHpsQr/ZDQ8o9g0W8J2AT1WTMNSQ4JTZvM8E5f/JE/tdGlFe29Tyk0q7V1DbTwDsLxuqr9ZN5/aUgec0nIbNIoGkgL0zRaT9rMIYdKnyKBN9ewlLSXGU0l74qW/oX737rDhpi+VIu+ewtpoTocXyeixI+9SenDJIoZMXEufRHW4woDL6xr4awo3xzYR7q7rI5LAjNvIMhRpYFcxV6dxMgP/SYvreVGW2+LtbGBDpygJCX41gBc2ngEIQrc97oLTkvkeeemITxZLMMKv5ZCfhKelo3HGUSbmYEKNDlbWtHLRwQnORUYqRiKK+xsXoFMOyL6NYV0E1nGDc4jdZSux/apJUHiHzeoOwz6JM1d/iYrji0q+J68eemlhvjJFs= 2022-01-09T08:54:54.753 INFO:teuthology.kill:2022-01-09 08:54:54,752.752 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T08:54:54.756 INFO:teuthology.kill:2022-01-09 08:54:54,756.756 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T08:54:54.833 INFO:teuthology.kill:2022-01-09 08:54:54,832.832 INFO:teuthology.orchestra.console:Power off smithi029 2022-01-09T08:54:54.846 INFO:teuthology.kill:2022-01-09 08:54:54,846.846 INFO:teuthology.orchestra.console:Power off smithi099 2022-01-09T08:55:03.214 INFO:teuthology.kill:2022-01-09 08:55:03,213.213 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2022-01-09T08:55:03.359 INFO:teuthology.kill:2022-01-09 08:55:03,358.358 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2022-01-09T08:55:07.321 INFO:teuthology.kill:2022-01-09 08:55:07,321.321 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-01-09T08:55:07.468 INFO:teuthology.kill:2022-01-09 08:55:07,468.468 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2022-01-09T08:57:07.803 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15