2022-01-15T04:15:13.982 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-15T04:15:14.110 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi053.front.sepia.ceph.com' reimaging 2022-01-15T04:15:14.111 INFO:teuthology.lock.ops:Updating [ubuntu@smithi053.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T04:15:14.111 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2022-01-15T04:15:14.131 INFO:teuthology.lock.ops:Node 'ubuntu@smithi053.front.sepia.ceph.com' reimaging is complete 2022-01-15T04:15:14.132 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging 2022-01-15T04:15:14.132 INFO:teuthology.lock.ops:Updating [ubuntu@smithi167.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T04:15:14.132 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2022-01-15T04:15:14.151 INFO:teuthology.lock.ops:Node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging is complete 2022-01-15T04:15:14.333 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.4 2022-01-15T04:15:14.348 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.4 2022-01-15T04:15:14.720 INFO:teuthology.orchestra.console:Power off smithi053 2022-01-15T04:15:14.778 INFO:teuthology.orchestra.console:Power off smithi167 2022-01-15T04:15:23.088 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2022-01-15T04:15:23.189 INFO:teuthology.orchestra.console:Power on smithi053 2022-01-15T04:15:27.252 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2022-01-15T04:15:27.354 INFO:teuthology.orchestra.console:Power on smithi167 2022-01-15T04:15:31.553 INFO:teuthology.orchestra.console:Power on for smithi053 completed 2022-01-15T04:15:31.654 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2022-01-15T04:15:35.716 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2022-01-15T04:15:35.817 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2022-01-15T04:19:48.094 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T04:20:06.393 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T04:20:06.585 INFO:teuthology.provision.fog.smithi053:Node is ready 2022-01-15T04:20:06.602 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2022-01-15T04:20:06.659 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2022-01-15T04:20:07.010 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2022-01-15T04:20:08.220 INFO:teuthology.provision.fog.smithi167:Node is ready 2022-01-15T04:20:08.239 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2022-01-15T04:20:08.296 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2022-01-15T04:20:08.636 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2022-01-15T04:20:08.784 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2022-01-15T04:20:08.785 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T04:20:08.805 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2022-01-15T04:20:08.805 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T04:20:08.830 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2022-01-15T04:20:08.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2022-01-15T04:20:09.030 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2022-01-15T04:20:09.088 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2022-01-15T04:20:09.088 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2022-01-15T04:20:09.089 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2022-01-15T04:20:09.089 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2022-01-15T04:20:09.089 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2022-01-15T04:20:09.090 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2022-01-15T04:20:09.090 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-15T04:20:09.090 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2022-01-15T04:20:09.090 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-15T04:20:09.091 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2022-01-15T04:20:09.091 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-15T04:20:09.091 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T04:20:09.091 INFO:teuthology.orchestra.run.smithi053.stdout: 2022-01-15T04:20:09.091 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T04:20:09.092 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-15T04:20:09.092 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-15T04:20:09.092 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-15T04:20:09.093 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2022-01-15T04:20:09.112 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2022-01-15T04:20:09.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2022-01-15T04:20:09.343 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2022-01-15T04:20:09.397 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2022-01-15T04:20:09.398 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.4 (Ootpa)" 2022-01-15T04:20:09.398 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2022-01-15T04:20:09.398 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2022-01-15T04:20:09.399 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.4" 2022-01-15T04:20:09.399 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2022-01-15T04:20:09.399 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-15T04:20:09.399 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2022-01-15T04:20:09.400 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-15T04:20:09.400 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2022-01-15T04:20:09.400 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-15T04:20:09.400 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T04:20:09.400 INFO:teuthology.orchestra.run.smithi167.stdout: 2022-01-15T04:20:09.401 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T04:20:09.401 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-15T04:20:09.401 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-15T04:20:09.402 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-15T04:20:09.402 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2022-01-15T04:20:09.500 INFO:teuthology.dispatcher.supervisor:Running job 6618713 2022-01-15T04:20:09.500 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi/6618713 --name yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi/6618713/orig.config.yaml 2022-01-15T04:20:09.504 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi/6618713 2022-01-15T04:20:09.505 INFO:teuthology.dispatcher.supervisor:Job PID: 30727 2022-01-15T04:20:09.506 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-15T10:50:20.583 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-15T10:50:20.756 INFO:teuthology.kill:Killing Pids: {30727} 2022-01-15T10:50:22.057 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-15T10:50:22.058 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-15T10:50:22.059 INFO:teuthology.misc:Compressing logs... 2022-01-15T10:50:22.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2022-01-15T10:50:22.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2022-01-15T10:50:22.306 INFO:teuthology.orchestra.run.smithi053.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T10:50:22.530 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T10:50:22.572 INFO:teuthology.orchestra.run.smithi053.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T10:50:22.572 INFO:teuthology.orchestra.run.smithi053.stderr:tar: Error is not recoverable: exiting now 2022-01-15T10:50:22.604 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T10:50:22.605 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2022-01-15T10:50:22.606 INFO:teuthology.misc:Compressing logs... 2022-01-15T10:50:22.804 INFO:teuthology.misc:Compressing logs... 2022-01-15T10:50:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-mon.smithi167.log: file size changed while zipping 2022-01-15T10:50:30.857 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-15T10:50:35.264 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-15T10:50:38.934 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-15T10:50:42.316 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-15T10:50:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-15T10:50:51.140 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-15T10:50:58.429 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-15T10:50:58.517 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-15T10:51:00.467 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-mgr.smithi053.cchbuy.log: file size changed while zipping 2022-01-15T10:51:10.616 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/f19c357c-75bb-11ec-8c32-001a4aab830c/ceph-mon.smithi053.log: file size changed while zipping 2022-01-15T10:51:27.735 INFO:teuthology.kill:No teuthology processes running 2022-01-15T10:51:28.949 INFO:teuthology.kill:Nuking machines: ['smithi053', 'smithi167'] 2022-01-15T10:51:29.929 INFO:teuthology.kill:2022-01-15 10:51:29,929.929 INFO:teuthology.nuke:targets: 2022-01-15T10:51:29.995 INFO:teuthology.kill: smithi053.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPCFpSAqxmkXJXE4BMNToX8GJD8EDaI+AecRYUSNfJczRzam6TZiRGorS8N2bQva+UZIh8axO52FRR6hNaOgjXWC6r2R7yo6Apur0lSD7stTvporftb5LVMOVaOUY9F3tPeCQ94wL5lvSC7uLts/yU3rUnxKKs5sCwosTMQmb1gfJF4doNagU/RVOsn8Jt//mJdF5IRJNzR6WkiSDwOAik2D5k73tWTPtqb4jl2LmYcHvqrBCH0CIIlyfuoeFd1Ah5mpxq7okHX8dYpAddEdMkGmAzN0PA1mjDkldgryrR268TD8o7bYfMBV/VxRLHvVk/LMNptoD0D+gpcerHT2xqs1c1vvGqvuXS+1VMEv1Q+XqWdIraZjMgLCQkN3D16Q1N1NTEg4Hzp6NpqyAXg58GrfbnyFmXkXJnOZ5W4GtsBy03th7tZTr3ZCut7uYFA/0jvLEeArU/OOkROqRM4JrJMrww3b4Va4PQSAOrLFFeeohBQusbSR7h6MBiGvUvG40= 2022-01-15T10:51:29.995 INFO:teuthology.kill: smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsFKPLOs4bK+36gsov9UUvNv1CU9YFb6WfoXbGwHGXaArPGoUl/VQfDSyBmBtxfr6ttUg/+h0UpLxCCUwpTYU7YLt8v7C19R5r0uZj6RnS8Wc2HHYzEkUclEuUeVPdBH34IVkC07PBxgQnx3yq9dX9Z/WLzftCYccMjYchS7AsRtEMqHCgSnxnhrPz/IG4NHedBoAZIQyWFokEmTPyCWEeSDjLraddkdbtdeVj5jnQTrZR4y4K+YERkPT+dY6460wHKteJMrIcGktAVR8QhXL/YJcAb9/tH2Ac+fmMx9hzd2hAhsN7erAs/UKNRbSc4s9wgA358RtbpwdEhZthDEfHQsIihep5tUM3C9YE4Z9dJQSypu8Z8w5lsLC33vdmv9QEtGkYgR3gV2OesxyD0dcOJWdPKeWb2jMbjP6XkNVdgBhpjWpIP7UuQVomB8RekkVTKVW5KLZcXECNolYB+jb+Zjx2b1eumWcUwFDIrt/wa3rPRU+EeWJ1jKtQkT5D4QU= 2022-01-15T10:51:29.996 INFO:teuthology.kill:2022-01-15 10:51:29,963.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T10:51:29.996 INFO:teuthology.kill:2022-01-15 10:51:29,967.967 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T10:51:30.048 INFO:teuthology.kill:2022-01-15 10:51:30,048.048 INFO:teuthology.orchestra.console:Power off smithi167 2022-01-15T10:51:30.064 INFO:teuthology.kill:2022-01-15 10:51:30,064.064 INFO:teuthology.orchestra.console:Power off smithi053 2022-01-15T10:51:42.585 INFO:teuthology.kill:2022-01-15 10:51:42,585.585 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2022-01-15T10:51:42.592 INFO:teuthology.kill:2022-01-15 10:51:42,592.592 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2022-01-15T10:51:42.733 INFO:teuthology.kill:2022-01-15 10:51:42,732.732 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2022-01-15T10:51:42.736 INFO:teuthology.kill:2022-01-15 10:51:42,736.736 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2022-01-15T10:53:43.053 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-15T10:53:43.147 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi053 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619195 2022-01-15T10:53:43.148 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619195