2022-01-17T18:07:07.411 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-17T18:07:07.531 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging 2022-01-17T18:07:07.532 INFO:teuthology.lock.ops:Updating [ubuntu@smithi059.front.sepia.ceph.com]: reset os type and version on server 2022-01-17T18:07:07.532 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-01-17T18:07:07.550 INFO:teuthology.lock.ops:Node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging is complete 2022-01-17T18:07:07.551 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging 2022-01-17T18:07:07.551 INFO:teuthology.lock.ops:Updating [ubuntu@smithi198.front.sepia.ceph.com]: reset os type and version on server 2022-01-17T18:07:07.551 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server 2022-01-17T18:07:07.569 INFO:teuthology.lock.ops:Node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging is complete 2022-01-17T18:07:07.765 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.4 2022-01-17T18:07:07.774 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of rhel 8.4 2022-01-17T18:07:08.088 INFO:teuthology.orchestra.console:Power off smithi198 2022-01-17T18:07:08.102 INFO:teuthology.orchestra.console:Power off smithi059 2022-01-17T18:07:16.459 INFO:teuthology.orchestra.console:Power off for smithi198 completed 2022-01-17T18:07:16.561 INFO:teuthology.orchestra.console:Power on smithi198 2022-01-17T18:07:20.578 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-01-17T18:07:20.679 INFO:teuthology.orchestra.console:Power on smithi059 2022-01-17T18:07:24.920 INFO:teuthology.orchestra.console:Power on for smithi198 completed 2022-01-17T18:07:24.928 INFO:teuthology.orchestra.console:Power on for smithi059 completed 2022-01-17T18:07:25.022 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish 2022-01-17T18:07:25.029 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2022-01-17T18:12:14.723 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-17T18:12:14.727 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-17T18:12:14.928 INFO:teuthology.provision.fog.smithi198:Node is ready 2022-01-17T18:12:14.934 INFO:teuthology.provision.fog.smithi059:Node is ready 2022-01-17T18:12:14.943 INFO:teuthology.orchestra.run.smithi198.stdout:smithi198.front.sepia.ceph.com 2022-01-17T18:12:14.950 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2022-01-17T18:12:14.998 INFO:teuthology.orchestra.run.smithi198.stdout:172.21.15.198 smithi198.front.sepia.ceph.com smithi198 2022-01-17T18:12:15.006 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2022-01-17T18:12:15.319 INFO:teuthology.provision.fog.smithi198:Deploy complete! 2022-01-17T18:12:15.327 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2022-01-17T18:12:15.506 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2022-01-17T18:12:15.507 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-17T18:12:15.527 INFO:teuthology.lock.ops:Checking smithi198.front.sepia.ceph.com 2022-01-17T18:12:15.527 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-17T18:12:15.546 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2022-01-17T18:12:15.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-01-17T18:12:15.775 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2022-01-17T18:12:15.830 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2022-01-17T18:12:15.831 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.4 (Ootpa)" 2022-01-17T18:12:15.831 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2022-01-17T18:12:15.831 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2022-01-17T18:12:15.832 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.4" 2022-01-17T18:12:15.832 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2022-01-17T18:12:15.832 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-17T18:12:15.832 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2022-01-17T18:12:15.833 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-17T18:12:15.833 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2022-01-17T18:12:15.833 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-17T18:12:15.833 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-17T18:12:15.833 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-17T18:12:15.834 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-17T18:12:15.834 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-17T18:12:15.834 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-17T18:12:15.834 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-17T18:12:15.836 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-01-17T18:12:15.854 INFO:teuthology.lock.ops:Updating [smithi198.front.sepia.ceph.com]: set os type and version on server 2022-01-17T18:12:15.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com' 2022-01-17T18:12:16.082 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64 2022-01-17T18:12:16.136 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="Red Hat Enterprise Linux" 2022-01-17T18:12:16.137 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="8.4 (Ootpa)" 2022-01-17T18:12:16.137 INFO:teuthology.orchestra.run.smithi198.stdout:ID="rhel" 2022-01-17T18:12:16.137 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE="fedora" 2022-01-17T18:12:16.137 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="8.4" 2022-01-17T18:12:16.137 INFO:teuthology.orchestra.run.smithi198.stdout:PLATFORM_ID="platform:el8" 2022-01-17T18:12:16.138 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-17T18:12:16.138 INFO:teuthology.orchestra.run.smithi198.stdout:ANSI_COLOR="0;31" 2022-01-17T18:12:16.138 INFO:teuthology.orchestra.run.smithi198.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-17T18:12:16.138 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://www.redhat.com/" 2022-01-17T18:12:16.139 INFO:teuthology.orchestra.run.smithi198.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-17T18:12:16.139 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-17T18:12:16.139 INFO:teuthology.orchestra.run.smithi198.stdout: 2022-01-17T18:12:16.139 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-17T18:12:16.139 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-17T18:12:16.140 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-17T18:12:16.140 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-17T18:12:16.141 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server 2022-01-17T18:12:16.244 INFO:teuthology.dispatcher.supervisor:Running job 6622555 2022-01-17T18:12:16.244 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-17_17:14:22-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6622555 --name yuriw-2022-01-17_17:14:22-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-17_17:14:22-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6622555/orig.config.yaml 2022-01-17T18:12:16.248 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-17_17:14:22-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6622555 2022-01-17T18:12:16.250 INFO:teuthology.dispatcher.supervisor:Job PID: 5372 2022-01-17T18:12:16.250 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-18T00:42:43.457 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-18T00:42:43.638 INFO:teuthology.kill:Killing Pids: {5372} 2022-01-18T00:42:44.763 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-18T00:42:44.764 INFO:teuthology.task.internal:roles: ubuntu@smithi198.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-18T00:42:44.764 INFO:teuthology.misc:Compressing logs... 2022-01-18T00:42:44.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-01-18T00:42:44.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com' 2022-01-18T00:42:44.984 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-18T00:42:45.217 INFO:teuthology.orchestra.run.smithi198.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-18T00:42:45.263 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-18T00:42:45.263 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2022-01-18T00:42:45.304 INFO:teuthology.orchestra.run.smithi198.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-18T00:42:45.304 INFO:teuthology.orchestra.run.smithi198.stderr:tar: Error is not recoverable: exiting now 2022-01-18T00:42:45.305 INFO:teuthology.misc:Compressing logs... 2022-01-18T00:42:45.517 INFO:teuthology.misc:Compressing logs... 2022-01-18T00:43:00.937 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-18T00:43:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-18T00:43:04.276 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-mon.smithi198.log: file size changed while zipping 2022-01-18T00:43:15.212 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-18T00:43:20.179 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-18T00:43:33.053 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-18T00:43:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-18T00:43:51.122 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-18T00:44:00.406 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-18T00:44:02.614 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-mgr.smithi059.lovbty.log: file size changed while zipping 2022-01-18T00:44:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/888e03b8-77c2-11ec-8c34-001a4aab830c/ceph-mon.smithi059.log: file size changed while zipping 2022-01-18T00:44:44.148 INFO:teuthology.kill:No teuthology processes running 2022-01-18T00:44:45.194 INFO:teuthology.kill:Nuking machines: ['smithi059', 'smithi198'] 2022-01-18T00:44:46.075 INFO:teuthology.kill:2022-01-18 00:44:46,075.075 INFO:teuthology.nuke:targets: 2022-01-18T00:44:46.076 INFO:teuthology.kill: smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuEQpFj0dul5Kgg/wob55jh9S1pdFKU7cvZJlYsbc6e9iK7ZxiEjSmo1yX+xwxa2ztd2+sKQQtD5sr6Yz6+zQqW8xoIBA0P0C6gzJ5SshkCuz/BBjHFs5+G3C5k7M3BG6sJ2AWs1Bid6F3Qy2Qm6/t+dCJigRDfJNIZW985SstrmsDOZGUpagSldQYEymBjlmGyksiBRC6oZX3sIxmNjFtGXq0MMqqzXOMOArQp+1IObqn9unM15WXj/BYB872ZYec473aTe+Ghlv0GjMogtZy56dKIvUngGACjkNNGD+0Lt3naTaSd1RUQYtPvaHRLesMXDu7+ewQOBolRKB9L6aDQgvUTWyjhGhaigvdnGx4U2UK+v13RlKaKvqBsNrkj/n9PYp/YhfZH7TDqSicxzgTyq47FN8FtHnHYyT3YZ6prZWx7T0RsBBcx8bhgMt1XciD9SsMFLJvqQKhXxSgsvF9SV1JCNX8lFDACJ+hCT+WVkd+OBg7hsUxeYHmbPD3Gtc= 2022-01-18T00:44:46.076 INFO:teuthology.kill: smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5dcT1i05cm8TwyRF0S4vFhdQawkuOVSzjXZw3+fl9ZSzDEFzqzf3sqvVam+56D0yvsSz+vjQRW5LRBP6lPAJvUZz/0WH/GH/9C5m3cG3LgEngnTPQozxXW8oF0X2XJ7GXbjt1Y2GzBEtg0zctrxnF1YirLHRBvtauXcuqf/Yopj2hf+wiNfhgaMfj/qBNakfrp1H4FlY8Ta59N+BVfx0pr+7vhRT3HBKtaljHVv7s/iF7TMuiRYxUbTArEwZxBetVG/+xzzlefixeQgM2TY+cqhNL/g4u3RGa3WmmybyHNLxEiJPjw+J/IHk69v6OoWM6D7RT7C/KxbjDsECxr9wC14dI2cOc7Q9Su9DoXP7eZ8WUnKncRlZUEjhLAzSXG20S5361RE0oTsUJIKy9UCsxEKivJviRyegJoheuvIkvH6kfCdnHmzLvUoCeVXEjXvXlwlGaHbEzJy+BJ8x83jIbva1Dw142zz9rE+tIgFDLln1TSlEQvxihxVRXmeTG+os= 2022-01-18T00:44:46.103 INFO:teuthology.kill:2022-01-18 00:44:46,103.103 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-18T00:44:46.106 INFO:teuthology.kill:2022-01-18 00:44:46,106.106 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-18T00:44:46.175 INFO:teuthology.kill:2022-01-18 00:44:46,175.175 INFO:teuthology.orchestra.console:Power off smithi059 2022-01-18T00:44:46.188 INFO:teuthology.kill:2022-01-18 00:44:46,187.187 INFO:teuthology.orchestra.console:Power off smithi198 2022-01-18T00:44:54.553 INFO:teuthology.kill:2022-01-18 00:44:54,553.553 INFO:teuthology.orchestra.console:Power off for smithi198 completed 2022-01-18T00:44:54.696 INFO:teuthology.kill:2022-01-18 00:44:54,695.695 INFO:teuthology.lock.ops:unlocked: smithi198.front.sepia.ceph.com 2022-01-18T00:44:58.658 INFO:teuthology.kill:2022-01-18 00:44:58,658.658 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-01-18T00:44:58.802 INFO:teuthology.kill:2022-01-18 00:44:58,802.802 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2022-01-18T00:46:59.079 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-18T00:46:59.168 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi059 but it was locked by another job: None