2022-01-22T11:34:46.018 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-22T11:34:46.147 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging
2022-01-22T11:34:46.149 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server
2022-01-22T11:34:46.149 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-01-22T11:34:46.168 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete
2022-01-22T11:34:46.169 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging
2022-01-22T11:34:46.169 INFO:teuthology.lock.ops:Updating [ubuntu@smithi167.front.sepia.ceph.com]: reset os type and version on server
2022-01-22T11:34:46.169 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-01-22T11:34:46.187 INFO:teuthology.lock.ops:Node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging is complete
2022-01-22T11:34:46.377 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream
2022-01-22T11:34:46.384 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 8.stream
2022-01-22T11:34:46.698 INFO:teuthology.orchestra.console:Power off smithi167
2022-01-22T11:34:46.714 INFO:teuthology.orchestra.console:Power off smithi017
2022-01-22T11:34:55.068 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-01-22T11:34:55.073 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-01-22T11:34:55.170 INFO:teuthology.orchestra.console:Power on smithi167
2022-01-22T11:34:55.178 INFO:teuthology.orchestra.console:Power on smithi017
2022-01-22T11:35:03.545 INFO:teuthology.orchestra.console:Power on for smithi017 completed
2022-01-22T11:35:03.552 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2022-01-22T11:35:03.647 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2022-01-22T11:35:03.653 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2022-01-22T11:39:20.488 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-22T11:39:20.767 INFO:teuthology.provision.fog.smithi017:Node is ready
2022-01-22T11:39:20.785 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2022-01-22T11:39:20.844 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2022-01-22T11:39:21.196 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2022-01-22T11:39:25.382 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-22T11:39:51.129 INFO:teuthology.provision.fog.smithi167:Node is ready
2022-01-22T11:39:51.151 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2022-01-22T11:39:51.210 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2022-01-22T11:39:51.568 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2022-01-22T11:39:51.723 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2022-01-22T11:39:51.724 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-22T11:39:51.743 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2022-01-22T11:39:51.743 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-22T11:39:51.760 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2022-01-22T11:39:51.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-01-22T11:39:52.008 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2022-01-22T11:39:52.065 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2022-01-22T11:39:52.065 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2022-01-22T11:39:52.065 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2022-01-22T11:39:52.065 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2022-01-22T11:39:52.066 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2022-01-22T11:39:52.066 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2022-01-22T11:39:52.066 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-22T11:39:52.066 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2022-01-22T11:39:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-22T11:39:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2022-01-22T11:39:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-22T11:39:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-22T11:39:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-22T11:39:52.069 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-01-22T11:39:52.088 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2022-01-22T11:39:52.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-01-22T11:39:52.281 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2022-01-22T11:39:52.337 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2022-01-22T11:39:52.337 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8"
2022-01-22T11:39:52.337 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2022-01-22T11:39:52.337 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2022-01-22T11:39:52.338 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8"
2022-01-22T11:39:52.338 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2022-01-22T11:39:52.338 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-22T11:39:52.338 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2022-01-22T11:39:52.339 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-22T11:39:52.339 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2022-01-22T11:39:52.339 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-22T11:39:52.339 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-22T11:39:52.339 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-22T11:39:52.340 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-01-22T11:39:52.430 INFO:teuthology.dispatcher.supervisor:Running job 6633794
2022-01-22T11:39:52.430 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-01-22_10:04:08-rados-WIP_GBH_NCB_new_alloc_map_A1-distro-basic-smithi/6633794 --name benhanokh-2022-01-22_10:04:08-rados-WIP_GBH_NCB_new_alloc_map_A1-distro-basic-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/benhanokh-2022-01-22_10:04:08-rados-WIP_GBH_NCB_new_alloc_map_A1-distro-basic-smithi/6633794/orig.config.yaml
2022-01-22T11:39:52.433 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-01-22_10:04:08-rados-WIP_GBH_NCB_new_alloc_map_A1-distro-basic-smithi/6633794
2022-01-22T11:39:52.434 INFO:teuthology.dispatcher.supervisor:Job PID: 2958
2022-01-22T11:39:52.434 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-22T18:10:21.855 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-22T18:10:22.047 INFO:teuthology.kill:Killing Pids: {2958}
2022-01-22T18:10:23.189 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-22T18:10:23.189 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-22T18:10:23.190 INFO:teuthology.misc:Compressing logs...
2022-01-22T18:10:23.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-01-22T18:10:23.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-01-22T18:10:23.439 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-22T18:10:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-22T18:10:23.667 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-22T18:10:23.668 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now
2022-01-22T18:10:23.712 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-22T18:10:23.712 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now
2022-01-22T18:10:23.713 INFO:teuthology.misc:Compressing logs...
2022-01-22T18:10:23.920 INFO:teuthology.misc:Compressing logs...
2022-01-22T18:10:31.371 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-22T18:10:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-22T18:10:40.343 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-22T18:10:40.399 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-22T18:10:49.347 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-22T18:10:50.814 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-22T18:10:52.654 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-mgr.smithi017.uyjloj.log: file size changed while zipping
2022-01-22T18:10:56.372 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-22T18:10:59.801 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-mon.smithi167.log: file size changed while zipping
2022-01-22T18:11:00.505 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-22T18:11:10.305 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/2ecca3f6-7b79-11ec-8c35-001a4aab830c/ceph-mon.smithi017.log: file size changed while zipping
2022-01-22T18:11:27.682 INFO:teuthology.kill:No teuthology processes running
2022-01-22T18:11:28.864 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi167']
2022-01-22T18:11:29.882 INFO:teuthology.kill:2022-01-22 18:11:29,882.882 INFO:teuthology.nuke:targets:
2022-01-22T18:11:29.885 INFO:teuthology.kill:  smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbgeVEgalfVgo6rb64vAgCUhGXdMj8IzuCGXYrwEXzCbcJxKuoxhnI5ponrEmqpo5mnJ98BG6v6d8LjIBcncwk3G1iFFah6cx+UXGxUiJa16gAUowWUaDg1u97nPoII4q09tsGyhNCAnEXG2faeWsQ6q309Z37SIHg3Of3YPTvpR1AShTDvQXsj8yhDnhKh5uZ5rD0gs+IIgcfAFEG9Ae7iEaPH/VFAfy4znfyOr8CiHG571WCQEUUXYr7Sea6+yTWFGfbNWKNFx1NvDX75i/O7HcmhXJskqw40Nnx5qrvMbl+wmT2FgcREjJXdNxQAcAi+DbFSsNEZzzSxSMd/97FSdF3WXh8V149ciUPwuLnB4+9vB2lDVnodGu+o3XCWZUWRHdrveQ+Vgd95024pqC6HCeDbu/eaXFrVaHeySFqiZ50YoEwguH8NnxDIXWnAZV4ZhOwX82aC0cDVkz0nUyCO6++JgpybTmUzkXqxq8ViGvDbTL0ueQYOZ+N+e0FC00=
2022-01-22T18:11:29.885 INFO:teuthology.kill:  smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYddfv1l/jOdGVvv3m8h+yDjvmT1cU5fgzTbgctq9DG++iByzjrJ44gzk9/UvsXyVyJnTKeglUdnihvK3PR0f+GizlVCXYQa+Zc/AdQu25MLP6/G9p/ipcVscBzDQ1Ef3CJAgqfXz7ev7kiwJGRlOvX28DWBXRy5gKZiwckRIJ57Rp0oBfBn+AQhKe5EbY++MKxu8gQLEZ98o12Z6M8unm3utaQsHZI3dl6UdOZpb4AeqXGmqE1ukVvtoRCRduW6ECVr6/tASrv0aVzlXYVdsRsgRKQEran4YN8E+8aC5VlGU/yY98xaMffkRtX78wzbE1c9pamps8Fpxnl2WcSgFqpJWq+c1+ukxayTyNEJtJbFG+XBvE7M3opt/YNgNTTGduyaqs2flzThxUcJKFK1ITE6uuphtThzOblp11vViDHI73eEFsRSAdnx4H6HVANcdwb2Kurs97Mag1KbBe6A4p9hQMLhxFAtUpLN92KNoiAqlfGybTDf+b9rFijJ3MxOc=
2022-01-22T18:11:29.911 INFO:teuthology.kill:2022-01-22 18:11:29,911.911 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-22T18:11:29.915 INFO:teuthology.kill:2022-01-22 18:11:29,915.915 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-22T18:11:29.991 INFO:teuthology.kill:2022-01-22 18:11:29,991.991 INFO:teuthology.orchestra.console:Power off smithi017
2022-01-22T18:11:30.005 INFO:teuthology.kill:2022-01-22 18:11:30,004.004 INFO:teuthology.orchestra.console:Power off smithi167
2022-01-22T18:11:38.365 INFO:teuthology.kill:2022-01-22 18:11:38,365.365 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-01-22T18:11:38.370 INFO:teuthology.kill:2022-01-22 18:11:38,370.370 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-01-22T18:11:38.518 INFO:teuthology.kill:2022-01-22 18:11:38,518.518 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com
2022-01-22T18:11:38.522 INFO:teuthology.kill:2022-01-22 18:11:38,522.522 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2022-01-22T18:13:38.806 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-22T18:13:38.898 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi017 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634858
2022-01-22T18:13:38.898 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634858