2023-01-11T20:21:04.240 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-11T20:21:04.357 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2023-01-11T20:21:04.358 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2023-01-11T20:21:04.359 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-01-11T20:21:04.376 INFO:teuthology.lock.ops:Node 'smithi162.front.sepia.ceph.com' reimaging is complete 2023-01-11T20:21:04.376 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging 2023-01-11T20:21:04.377 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server 2023-01-11T20:21:04.377 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2023-01-11T20:21:04.393 INFO:teuthology.lock.ops:Node 'smithi165.front.sepia.ceph.com' reimaging is complete 2023-01-11T20:21:04.541 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream 2023-01-11T20:21:04.544 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream 2023-01-11T20:21:04.818 INFO:teuthology.orchestra.console:Power off smithi165 2023-01-11T20:21:04.831 INFO:teuthology.orchestra.console:Power off smithi162 2023-01-11T20:21:04.966 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2023-01-11T20:21:04.970 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2023-01-11T20:21:05.068 INFO:teuthology.orchestra.console:Power on smithi165 2023-01-11T20:21:05.077 INFO:teuthology.orchestra.console:Power on smithi162 2023-01-11T20:21:09.327 INFO:teuthology.orchestra.console:Power on for smithi165 completed 2023-01-11T20:21:09.332 INFO:teuthology.orchestra.console:Power on for smithi162 completed 2023-01-11T20:21:09.429 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2023-01-11T20:21:09.434 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2023-01-11T20:24:14.032 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-01-11T20:24:14.034 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-11T20:24:23.116 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-01-11T20:24:23.116 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-11T20:24:32.172 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-01-11T20:24:32.172 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-11T20:24:41.260 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-01-11T20:24:41.261 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-11T20:24:50.316 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-01-11T20:24:50.317 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-11T20:24:59.372 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-11T20:25:37.311 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-11T20:25:56.322 WARNING:teuthology.provision.fog:timed out 2023-01-11T20:26:02.594 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-11T20:26:02.693 INFO:teuthology.provision.fog.smithi165:Node is ready 2023-01-11T20:26:02.756 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com 2023-01-11T20:26:02.818 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165 2023-01-11T20:26:02.876 INFO:teuthology.provision.fog.smithi162:Node is ready 2023-01-11T20:26:02.897 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2023-01-11T20:26:02.956 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2023-01-11T20:26:03.212 INFO:teuthology.provision.fog.smithi165:Deploy complete! 2023-01-11T20:26:03.320 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2023-01-11T20:26:03.494 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2023-01-11T20:26:03.495 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-11T20:26:03.513 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com 2023-01-11T20:26:03.514 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-11T20:26:03.531 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2023-01-11T20:26:03.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-01-11T20:26:03.722 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-01-11T20:26:03.780 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2023-01-11T20:26:03.781 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2023-01-11T20:26:03.781 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2023-01-11T20:26:03.781 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2023-01-11T20:26:03.781 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2023-01-11T20:26:03.781 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2023-01-11T20:26:03.782 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-11T20:26:03.782 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2023-01-11T20:26:03.782 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-11T20:26:03.782 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2023-01-11T20:26:03.782 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-11T20:26:03.783 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-11T20:26:03.783 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-11T20:26:03.784 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-01-11T20:26:03.805 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server 2023-01-11T20:26:03.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-01-11T20:26:04.040 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2023-01-11T20:26:04.098 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2023-01-11T20:26:04.098 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8" 2023-01-11T20:26:04.099 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2023-01-11T20:26:04.099 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2023-01-11T20:26:04.099 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8" 2023-01-11T20:26:04.099 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2023-01-11T20:26:04.099 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-11T20:26:04.100 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2023-01-11T20:26:04.100 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-11T20:26:04.100 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2023-01-11T20:26:04.100 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-11T20:26:04.101 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-11T20:26:04.101 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-11T20:26:04.101 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2023-01-11T20:26:04.186 INFO:teuthology.dispatcher.supervisor:Running job 7133555 2023-01-11T20:26:04.186 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-01-11_19:37:47-orch:cephadm-wip-guits-testing-2023-01-11-1536-distro-default-smithi/7133555 --name adking-2023-01-11_19:37:47-orch:cephadm-wip-guits-testing-2023-01-11-1536-distro-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} -- /home/teuthworker/archive/adking-2023-01-11_19:37:47-orch:cephadm-wip-guits-testing-2023-01-11-1536-distro-default-smithi/7133555/orig.config.yaml 2023-01-11T20:26:04.191 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-01-11_19:37:47-orch:cephadm-wip-guits-testing-2023-01-11-1536-distro-default-smithi/7133555 2023-01-11T20:26:04.192 INFO:teuthology.dispatcher.supervisor:Job PID: 25898 2023-01-11T20:26:04.192 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-01-12T08:26:29.455 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-01-12T08:26:29.587 INFO:teuthology.kill:Killing Pids: {25898} 2023-01-12T08:26:30.377 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['host.a', 'client.0'] 2023-01-12T08:26:30.378 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['host.b', 'client.1'] 2023-01-12T08:26:30.378 INFO:teuthology.misc:Compressing logs... 2023-01-12T08:26:30.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-01-12T08:26:30.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-01-12T08:26:30.609 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2023-01-12T08:26:30.759 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2023-01-12T08:26:30.803 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-01-12T08:26:30.803 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2023-01-12T08:26:30.852 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-01-12T08:26:30.853 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now 2023-01-12T08:26:30.854 INFO:teuthology.misc:Compressing logs... 2023-01-12T08:26:31.003 INFO:teuthology.misc:Compressing logs... 2023-01-12T08:26:31.583 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/5dcc4e30-91ef-11ed-821a-001a4aab830c/ceph-mgr.smithi162.znmsjb.log: file size changed while zipping 2023-01-12T08:26:32.092 INFO:teuthology.kill:No teuthology processes running 2023-01-12T08:26:32.789 INFO:teuthology.kill:Nuking machines: ['smithi162', 'smithi165'] 2023-01-12T08:26:33.382 INFO:teuthology.kill:2023-01-12 08:26:33,382.382 INFO:teuthology.nuke:targets: 2023-01-12T08:26:33.383 INFO:teuthology.kill: smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4T4tH6yZcsQpiEZuRBNySQIZzt73hkhWfBFSdDOookV8TlgbBu25P2uyvQiQFsGS8wMV7uID9ziqzLbU6mbGPIW7YBrlusDZNEIBcBIBnhlAf06LwV6ZT4NtJP4LYfTmjtHqxyHiX3vipyqqxQhY3M3SAtEFtomVknslkKLpAX4AqW1HVKW0tnZjHUtEw8VIPTMWPP70XAy1jy5KaL5qdHgenYB+g5xinxWXOHyy3soiiZ4hYCAesKKkGWdvab9oTyef/kS/jPBrGUQ9ZMz0TSz/9kaHTRpPOpiz5GOhKvmjo8mhms5OH4z/c+2gEwaZa+bF2im/O8MixyVJeyipqJUK8LyEhL8Ryzjb09ganFHY2rmBheifcPe7j2Uq6QjER5rlp6xQ0eCH7Gx4Nsm46GxtV037jsBsFnPteSKTvskq9qrKTUXKcpsFUpMM/qPgT07CoCg1p3mCThoa2qTFP4TLM1t3Df+wpLWsT/Cgegy8AX+wYeOpXbF2C+8KjC6M= 2023-01-12T08:26:33.383 INFO:teuthology.kill: smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4p6uNBmLBrQrHPjUXO4Ye9p48fLfsIId+U997NhhkZKJsPrg4hiQlfbHSVfNoPYFcilXaH9thNxCxnkV4Mi9NEWDMmK3t7VCt1K0T3SNfjN/5Rsxqn9Ntg0hKdBjaEnQK8JMR2fGDFpKJU3ctmEkJUOpyISbOrneDz8mTRyDEcFpXmt90OeD3RTMIsZumotvGu05LwPterot4xSF1ooIVKk5fEolT9v9PlISnSr9OkdIk1UsomduCHfxM0fZm/MK2GmO7Kf6Y4QLbH2LhTgmKtfFaK6E7KunjJACrur64jGFthS0a7eAGMpS9Y6O0jRnzb4T813KOaL6OE87YiuWkcVfsvu9paPMB1y1PcwQgxgczLwtHYPFmuv/TallNAf89NfkSI2a+3MQE4Re72eg+IWQIfDUcxJXuYkkUhgefNnMuHJjS1lSyQNM1rendjW8ULFPYoWA+4s4mcIgRxN67tdXNFS56VLGz+XkTaCX/ltemryYSrccg8xjEsg6LOj8= 2023-01-12T08:26:33.384 INFO:teuthology.kill:2023-01-12 08:26:33,384.384 INFO:teuthology.nuke:Checking targets against current locks 2023-01-12T08:26:33.448 INFO:teuthology.kill:2023-01-12 08:26:33,447.447 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-12T08:26:33.476 INFO:teuthology.kill:2023-01-12 08:26:33,475.475 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-12T08:26:33.538 INFO:teuthology.kill:2023-01-12 08:26:33,537.537 INFO:teuthology.orchestra.console:Power off smithi162 2023-01-12T08:26:33.577 INFO:teuthology.kill:2023-01-12 08:26:33,577.577 INFO:teuthology.orchestra.console:Power off smithi165 2023-01-12T08:26:46.027 INFO:teuthology.kill:2023-01-12 08:26:46,027.027 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2023-01-12T08:26:46.057 INFO:teuthology.kill:2023-01-12 08:26:46,056.056 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2023-01-12T08:26:46.188 INFO:teuthology.kill:2023-01-12 08:26:46,187.187 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com 2023-01-12T08:26:46.210 INFO:teuthology.kill:2023-01-12 08:26:46,210.210 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com 2023-01-12T08:28:46.534 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-01-12T08:28:46.622 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi162 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-01-11_21:27:51-rados-wip-yuri2-testing-2023-01-11-0819-distro-default-smithi/7134520 2023-01-12T08:28:46.623 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi165 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-01-11_21:27:51-rados-wip-yuri2-testing-2023-01-11-0819-distro-default-smithi/7134520