2022-02-13T23:25:00.725 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-13T23:25:00.846 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi118.front.sepia.ceph.com' reimaging 2022-02-13T23:25:00.847 INFO:teuthology.lock.ops:Updating [ubuntu@smithi118.front.sepia.ceph.com]: reset os type and version on server 2022-02-13T23:25:00.847 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2022-02-13T23:25:00.867 INFO:teuthology.lock.ops:Node 'ubuntu@smithi118.front.sepia.ceph.com' reimaging is complete 2022-02-13T23:25:00.868 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging 2022-02-13T23:25:00.868 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server 2022-02-13T23:25:00.868 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2022-02-13T23:25:00.887 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete 2022-02-13T23:25:01.088 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 8.stream 2022-02-13T23:25:01.100 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.stream 2022-02-13T23:25:01.558 INFO:teuthology.orchestra.console:Power off smithi197 2022-02-13T23:25:01.610 INFO:teuthology.orchestra.console:Power off smithi118 2022-02-13T23:25:09.944 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2022-02-13T23:25:09.974 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2022-02-13T23:25:10.046 INFO:teuthology.orchestra.console:Power on smithi197 2022-02-13T23:25:10.076 INFO:teuthology.orchestra.console:Power on smithi118 2022-02-13T23:25:14.325 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2022-02-13T23:25:14.426 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2022-02-13T23:25:18.407 INFO:teuthology.orchestra.console:Power on for smithi197 completed 2022-02-13T23:25:18.508 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish 2022-02-13T23:29:59.438 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-13T23:29:59.700 INFO:teuthology.provision.fog.smithi197:Node is ready 2022-02-13T23:29:59.730 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com 2022-02-13T23:29:59.795 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197 2022-02-13T23:30:00.170 INFO:teuthology.provision.fog.smithi197:Deploy complete! 2022-02-13T23:30:09.071 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-13T23:30:34.251 INFO:teuthology.provision.fog.smithi118:Node is ready 2022-02-13T23:30:34.274 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2022-02-13T23:30:34.335 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2022-02-13T23:30:34.755 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2022-02-13T23:30:34.943 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2022-02-13T23:30:34.943 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-13T23:30:34.967 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com 2022-02-13T23:30:34.968 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-13T23:30:34.987 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2022-02-13T23:30:34.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2022-02-13T23:30:35.224 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2022-02-13T23:30:35.281 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2022-02-13T23:30:35.281 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8" 2022-02-13T23:30:35.282 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2022-02-13T23:30:35.282 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2022-02-13T23:30:35.282 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8" 2022-02-13T23:30:35.282 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2022-02-13T23:30:35.283 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-13T23:30:35.283 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2022-02-13T23:30:35.283 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-13T23:30:35.283 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2022-02-13T23:30:35.284 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-13T23:30:35.284 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-13T23:30:35.284 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-13T23:30:35.285 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2022-02-13T23:30:35.304 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server 2022-02-13T23:30:35.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com' 2022-02-13T23:30:35.550 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2022-02-13T23:30:35.608 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Stream" 2022-02-13T23:30:35.608 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8" 2022-02-13T23:30:35.608 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos" 2022-02-13T23:30:35.609 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora" 2022-02-13T23:30:35.609 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8" 2022-02-13T23:30:35.609 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8" 2022-02-13T23:30:35.609 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-13T23:30:35.610 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31" 2022-02-13T23:30:35.610 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-13T23:30:35.610 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://centos.org/" 2022-02-13T23:30:35.611 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-13T23:30:35.611 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-13T23:30:35.612 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-13T23:30:35.612 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2022-02-13T23:30:35.709 INFO:teuthology.dispatcher.supervisor:Running job 6681034 2022-02-13T23:30:35.709 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_mgfritch@teuthology --archive /home/teuthworker/archive/mgfritch-2022-02-13_17:09:38-orch:cephadm-wip-mgfritch-testing-2022-02-12-1443-distro-default-smithi/6681034 --name mgfritch-2022-02-13_17:09:38-orch:cephadm-wip-mgfritch-testing-2022-02-12-1443-distro-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/mgfritch-2022-02-13_17:09:38-orch:cephadm-wip-mgfritch-testing-2022-02-12-1443-distro-default-smithi/6681034/orig.config.yaml 2022-02-13T23:30:35.714 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mgfritch-2022-02-13_17:09:38-orch:cephadm-wip-mgfritch-testing-2022-02-12-1443-distro-default-smithi/6681034 2022-02-13T23:30:35.715 INFO:teuthology.dispatcher.supervisor:Job PID: 8588 2022-02-13T23:30:35.715 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-14T06:01:02.159 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-14T06:01:02.385 INFO:teuthology.kill:Killing Pids: {8588} 2022-02-14T06:01:03.582 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-02-14T06:01:03.584 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-02-14T06:01:03.584 INFO:teuthology.misc:Compressing logs... 2022-02-14T06:01:03.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2022-02-14T06:01:03.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com' 2022-02-14T06:01:03.830 INFO:teuthology.orchestra.run.smithi118.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-02-14T06:01:04.018 INFO:teuthology.orchestra.run.smithi197.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-02-14T06:01:04.058 INFO:teuthology.orchestra.run.smithi118.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-02-14T06:01:04.058 INFO:teuthology.orchestra.run.smithi118.stderr:tar: Error is not recoverable: exiting now 2022-02-14T06:01:04.209 INFO:teuthology.orchestra.run.smithi197.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-02-14T06:01:04.209 INFO:teuthology.orchestra.run.smithi197.stderr:tar: Error is not recoverable: exiting now 2022-02-14T06:01:04.210 INFO:teuthology.misc:Compressing logs... 2022-02-14T06:01:04.391 INFO:teuthology.misc:Compressing logs... 2022-02-14T06:01:13.508 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-02-14T06:01:13.787 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-mon.smithi118.log: file size changed while zipping 2022-02-14T06:01:20.533 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-02-14T06:01:21.158 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-02-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-mgr.smithi118.kwrpps.log: file size changed while zipping 2022-02-14T06:01:23.974 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-mon.smithi197.log: file size changed while zipping 2022-02-14T06:01:31.076 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-02-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-02-14T06:01:40.302 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-02-14T06:01:40.894 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-02-14T06:01:48.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/dc747f3e-8d25-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-02-14T06:02:05.451 INFO:teuthology.kill:No teuthology processes running 2022-02-14T06:02:06.555 INFO:teuthology.kill:Nuking machines: ['smithi118', 'smithi197'] 2022-02-14T06:02:07.479 INFO:teuthology.kill:2022-02-14 06:02:07,479.479 INFO:teuthology.nuke:targets: 2022-02-14T06:02:07.480 INFO:teuthology.kill: smithi118.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC53TPTw7TDLoX5CDkEEuRd9ThAGMkUE5k9cZS3OnIs6v2wFuSer9WIeqZ+FqZZIhfgrLHXzkmM38abtyOGPt0s9dSXmtU5H99WgoBwbeUIijRcOj8dmGqOEbrbJ1SCmo6Vu/VJx2oESZc6mH/53akIS0/l0wsfTFVZ3Sm9/dxHWAeDKBTYjP0riSZstsqw0dgR2Rffx9HLGdKcjgBGV6q6KJ/Txmma8k2Z9IaHhKrr/Fss2YS8akAlnQypPD5lRc4ktHa+hgafkBPLWw39NOAcOa2DRYuoys6aitVhx8HzcKzF+M6eLW0Mg78cPKWCP7ViC9kel7RfdTQ5+KIUmnTQHbzbAnJUM3fbIOFJRB9KlQOt8X2GNqz6WVwZOqGEaZ2w0fQqWCF/ufJTqdEKOB5XEKdQML2GlJUaIN/i+pg1GFjzAB39J3Prr2HSuTPDfAgaNKH3ruoSAiVx2BNa3oXRQayLRLmNs98RLsUDPDRayvL3SnTIlKQxG809wa9OBlM= 2022-02-14T06:02:07.480 INFO:teuthology.kill: smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9M1OA566Inlnp9ej+yuoRBjehGbIELiiK9fqOwLjj75L6pbA+KlUGEqR4FFHkpcIXhjli/1tlIIHP8aQBluI2lgXlMjGUx6A15vnuU9v9rpu7LPACEk6E73dfTjEaQdnvcg9uXJk0VyoxAYX8CZN3sraeToGM2b9MZc+8BDkgftiGJeZlanrcSopW6fn6aYNqaRuG/q6RLtRMKECUaW67b3pXbbrtbzAAdLA29qt6ztNirWwxJA56GMp2Hlm/wn3nalJNPVkdByGfsNyTjsrf8NURw+TsqZ2wiYn7EOWYPM2JJXzpIvTmpxvwQmrOQNXvZwtzeMR+lrlDKNt7VLQP1pnyu1/l75moq3MIvCtpCeVSza3p/o6S7FwDCH9pRVmBkLjaSxV5AvqOfY9QBC2ykm3UIeRiVsVemxu9Afs8g9ZeTvyC6ncPMpJOXN/TuUOGVSWwOLAtKp8G/V7Tmaw/tPLT+drDNRchscA3U0Zcr5l/lHpeZpLNOGeaFss2sg8= 2022-02-14T06:02:07.506 INFO:teuthology.kill:2022-02-14 06:02:07,506.506 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-14T06:02:07.510 INFO:teuthology.kill:2022-02-14 06:02:07,509.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-14T06:02:07.585 INFO:teuthology.kill:2022-02-14 06:02:07,585.585 INFO:teuthology.orchestra.console:Power off smithi197 2022-02-14T06:02:07.598 INFO:teuthology.kill:2022-02-14 06:02:07,597.597 INFO:teuthology.orchestra.console:Power off smithi118 2022-02-14T06:02:20.064 INFO:teuthology.kill:2022-02-14 06:02:20,064.064 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2022-02-14T06:02:20.070 INFO:teuthology.kill:2022-02-14 06:02:20,070.070 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2022-02-14T06:02:20.215 INFO:teuthology.kill:2022-02-14 06:02:20,214.214 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2022-02-14T06:02:20.218 INFO:teuthology.kill:2022-02-14 06:02:20,218.218 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com 2022-02-14T06:04:20.515 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-14T06:04:20.609 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi118 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-14_02:47:04-upgrade:nautilus-x-octopus-distro-default-smithi/6681321 2022-02-14T06:04:20.610 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-14_02:47:04-upgrade:nautilus-x-octopus-distro-default-smithi/6681321