2022-01-08T18:45:48.787 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-08T18:45:48.919 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging 2022-01-08T18:45:48.920 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T18:45:48.920 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-01-08T18:45:48.938 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete 2022-01-08T18:45:48.939 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging 2022-01-08T18:45:48.939 INFO:teuthology.lock.ops:Updating [ubuntu@smithi050.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T18:45:48.940 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-01-08T18:45:48.959 INFO:teuthology.lock.ops:Node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging is complete 2022-01-08T18:45:49.157 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of centos 8.stream 2022-01-08T18:45:49.172 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream 2022-01-08T18:45:49.532 INFO:teuthology.orchestra.console:Power off smithi050 2022-01-08T18:45:49.547 INFO:teuthology.orchestra.console:Power off smithi036 2022-01-08T18:45:57.907 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-01-08T18:45:58.009 INFO:teuthology.orchestra.console:Power on smithi050 2022-01-08T18:46:02.024 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-01-08T18:46:02.125 INFO:teuthology.orchestra.console:Power on smithi036 2022-01-08T18:46:06.385 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2022-01-08T18:46:06.486 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2022-01-08T18:46:10.491 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2022-01-08T18:46:10.592 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2022-01-08T18:50:41.331 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T18:50:41.578 INFO:teuthology.provision.fog.smithi050:Node is ready 2022-01-08T18:50:41.635 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2022-01-08T18:50:41.692 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2022-01-08T18:50:42.027 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2022-01-08T18:50:45.104 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T18:50:45.367 INFO:teuthology.provision.fog.smithi036:Node is ready 2022-01-08T18:50:45.384 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2022-01-08T18:50:45.441 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2022-01-08T18:50:45.765 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2022-01-08T18:50:45.936 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2022-01-08T18:50:45.937 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T18:50:45.960 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2022-01-08T18:50:45.960 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T18:50:45.980 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2022-01-08T18:50:45.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-01-08T18:50:46.171 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2022-01-08T18:50:46.227 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="CentOS Stream" 2022-01-08T18:50:46.228 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8" 2022-01-08T18:50:46.228 INFO:teuthology.orchestra.run.smithi036.stdout:ID="centos" 2022-01-08T18:50:46.228 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="rhel fedora" 2022-01-08T18:50:46.229 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8" 2022-01-08T18:50:46.229 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8" 2022-01-08T18:50:46.229 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-08T18:50:46.229 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31" 2022-01-08T18:50:46.229 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T18:50:46.230 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://centos.org/" 2022-01-08T18:50:46.230 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-08T18:50:46.230 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-08T18:50:46.230 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-08T18:50:46.232 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-01-08T18:50:46.257 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2022-01-08T18:50:46.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-01-08T18:50:46.455 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2022-01-08T18:50:46.514 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2022-01-08T18:50:46.514 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2022-01-08T18:50:46.515 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2022-01-08T18:50:46.515 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2022-01-08T18:50:46.515 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2022-01-08T18:50:46.515 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2022-01-08T18:50:46.516 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-08T18:50:46.516 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2022-01-08T18:50:46.516 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T18:50:46.516 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2022-01-08T18:50:46.516 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-08T18:50:46.517 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-08T18:50:46.517 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-08T18:50:46.518 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-01-08T18:50:46.615 INFO:teuthology.dispatcher.supervisor:Running job 6603119 2022-01-08T18:50:46.615 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603119 --name yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603119/orig.config.yaml 2022-01-08T18:50:46.619 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603119 2022-01-08T18:50:46.620 INFO:teuthology.dispatcher.supervisor:Job PID: 23945 2022-01-08T18:50:46.620 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-09T06:51:41.504 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-09T06:51:41.690 INFO:teuthology.kill:Killing Pids: {23945} 2022-01-09T06:51:42.880 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-09T06:51:42.881 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-09T06:51:42.881 INFO:teuthology.misc:Compressing logs... 2022-01-09T06:51:42.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-01-09T06:51:43.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-01-09T06:51:43.130 INFO:teuthology.orchestra.run.smithi036.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T06:51:43.321 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T06:51:43.359 INFO:teuthology.orchestra.run.smithi036.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T06:51:43.359 INFO:teuthology.orchestra.run.smithi036.stderr:tar: Error is not recoverable: exiting now 2022-01-09T06:51:43.408 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T06:51:43.409 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2022-01-09T06:51:43.410 INFO:teuthology.misc:Compressing logs... 2022-01-09T06:51:43.622 INFO:teuthology.misc:Compressing logs... 2022-01-09T06:51:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-09T06:51:48.638 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-09T06:51:49.627 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-mgr.smithi036.dhpgjn.log: file size changed while zipping 2022-01-09T06:51:53.506 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-09T06:51:54.173 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-09T06:51:58.837 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-09T06:52:00.195 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-09T06:52:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-09T06:52:05.128 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-mon.smithi050.log: file size changed while zipping 2022-01-09T06:52:05.860 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-mon.smithi036.log: file size changed while zipping 2022-01-09T06:52:10.385 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/19a94cfa-70b5-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-09T06:52:43.036 INFO:teuthology.kill:No teuthology processes running 2022-01-09T06:52:44.291 INFO:teuthology.kill:Nuking machines: ['smithi036', 'smithi050'] 2022-01-09T06:52:45.318 INFO:teuthology.kill:2022-01-09 06:52:45,317.317 INFO:teuthology.nuke:targets: 2022-01-09T06:52:45.319 INFO:teuthology.kill: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6mYYzmnbAuESchSpANWwKeL3BI7oWDVRaCDTiUlIEDENENlr9vJOo43oue6gNsqdHH7xNw9as5mSJdzNCvuEj5g4kaoKMV3er89wjCk50HDAM1mVhnZE9m12MWCNLEBxUkr4Cx2idrVAma9QH30D+7IhXd+Ugln34G38Gjm2YEBcv1+eIRPuEaeoIxnjI56KF5vekaexr2rATdIYDC8cg/Et5D5NntyLr1pz9Yg7B9vzZKrnNjeXUJWbPH49ek2V3Qf7ZdhGMDKuGFeR/M/UtCW5a/lq5QUDD4CVBL+Pw5pEjnGS03rQpQ3zTwl6YIjEa08QuT6ghvxx8WDdpMGVFxUJgM/H2MFjwn5XBBDZBDx4C1uhFR5E9SGG3IkRf1y0EOJ/UqloLM4j4Iitg1QtTkgmEmapQNTc0A3hmxjw0KDe/DXGqYJO4l8OPIP3/Kx411hbDCG4d+zNPD6EILOdeq/2meufuLipw3MdWbn+Mn1NhfC1qnIOewoW7OGHUaiE= 2022-01-09T06:52:45.319 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDECEPXaag9WlKlrRg7y0Id6084Uzm0ct70+6xa34qAE39qtd0F2MMWFygm1bD3myJGbDcxoeAUVZ/MK7FPp8fLxzIUAtTrzCyg75bQGNpYt0Ldd+O3mRhGqOBCvcOP+8fCgqkAINuaTrVEb5D7iKw6hKeQUaKaSrG638bHEAyNnLI7gS0T9ZbhwR6UteWWeZ7dC7x52WmRQQBLj2kLwRoamu2J5G63PDYlB2vPz1Z0GPhGF/lO51xWQGaiVDG+YxgS0UG1JkygTCN3lz7Agr9V8w7SuiTMULm9LXFxGJXAqWppOzHBMqovCDk0PNjNw/DmEj64iJCGWz3zge/Vtn5+3rO69b/64s6jlUSrhTCxSEW9/8XtUn5naj1XisZyXj+i/CWD3D+2d4yW9DDISo8LOcGT4ZoUuxBUIdnteiw3P7g8MALqaL5g2rmWmIXnpcPBeG4VL4ETsOlaIsbRijKNis08M2C+Bd2xKMKgvjvQ2Pz9DJ057QzCpNi8wDRHuuE= 2022-01-09T06:52:45.355 INFO:teuthology.kill:2022-01-09 06:52:45,355.355 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T06:52:45.359 INFO:teuthology.kill:2022-01-09 06:52:45,359.359 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T06:52:45.439 INFO:teuthology.kill:2022-01-09 06:52:45,439.439 INFO:teuthology.orchestra.console:Power off smithi036 2022-01-09T06:52:45.452 INFO:teuthology.kill:2022-01-09 06:52:45,452.452 INFO:teuthology.orchestra.console:Power off smithi050 2022-01-09T06:52:53.812 INFO:teuthology.kill:2022-01-09 06:52:53,811.811 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-01-09T06:52:53.978 INFO:teuthology.kill:2022-01-09 06:52:53,977.977 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com 2022-01-09T06:52:57.931 INFO:teuthology.kill:2022-01-09 06:52:57,931.931 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-01-09T06:52:58.080 INFO:teuthology.kill:2022-01-09 06:52:58,079.079 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2022-01-09T06:54:58.395 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-09T06:54:58.522 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi036 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_05:17:03-krbd-pacific-testing-default-smithi/6600771 2022-01-09T06:54:58.522 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_05:17:03-krbd-pacific-testing-default-smithi/6600771