2021-11-16T15:34:49.930 INFO:root:teuthology version: 1.1.0-6cfddd5e
2021-11-16T15:34:50.052 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging
2021-11-16T15:34:50.053 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server
2021-11-16T15:34:50.053 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2021-11-16T15:34:50.071 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete
2021-11-16T15:34:50.071 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging
2021-11-16T15:34:50.072 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server
2021-11-16T15:34:50.072 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-11-16T15:34:50.090 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete
2021-11-16T15:34:50.307 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream
2021-11-16T15:34:50.314 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 8.stream
2021-11-16T15:34:50.672 INFO:teuthology.orchestra.console:Power off smithi183
2021-11-16T15:34:50.688 INFO:teuthology.orchestra.console:Power off smithi156
2021-11-16T15:34:59.046 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-11-16T15:34:59.056 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2021-11-16T15:34:59.148 INFO:teuthology.orchestra.console:Power on smithi183
2021-11-16T15:34:59.157 INFO:teuthology.orchestra.console:Power on smithi156
2021-11-16T15:35:07.636 INFO:teuthology.orchestra.console:Power on for smithi183 completed
2021-11-16T15:35:07.638 INFO:teuthology.orchestra.console:Power on for smithi156 completed
2021-11-16T15:35:07.738 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2021-11-16T15:35:07.743 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2021-11-16T15:39:57.440 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-16T15:39:57.752 INFO:teuthology.provision.fog.smithi183:Node is ready
2021-11-16T15:39:57.769 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2021-11-16T15:39:57.826 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2021-11-16T15:39:58.170 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2021-11-16T15:40:12.437 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-16T15:40:12.716 INFO:teuthology.provision.fog.smithi156:Node is ready
2021-11-16T15:40:12.733 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2021-11-16T15:40:12.792 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2021-11-16T15:40:13.141 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2021-11-16T15:40:13.287 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2021-11-16T15:40:13.288 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-16T15:40:13.314 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2021-11-16T15:40:13.314 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-16T15:40:13.334 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2021-11-16T15:40:13.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2021-11-16T15:40:13.522 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2021-11-16T15:40:13.578 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2021-11-16T15:40:13.578 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8"
2021-11-16T15:40:13.578 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2021-11-16T15:40:13.579 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2021-11-16T15:40:13.579 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8"
2021-11-16T15:40:13.579 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2021-11-16T15:40:13.579 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-16T15:40:13.580 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2021-11-16T15:40:13.580 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-16T15:40:13.580 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2021-11-16T15:40:13.580 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-16T15:40:13.581 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-16T15:40:13.581 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-16T15:40:13.582 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2021-11-16T15:40:13.600 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2021-11-16T15:40:13.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2021-11-16T15:40:13.839 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2021-11-16T15:40:13.895 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2021-11-16T15:40:13.895 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8"
2021-11-16T15:40:13.896 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2021-11-16T15:40:13.896 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2021-11-16T15:40:13.896 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8"
2021-11-16T15:40:13.896 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2021-11-16T15:40:13.897 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-16T15:40:13.897 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2021-11-16T15:40:13.897 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-16T15:40:13.897 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2021-11-16T15:40:13.898 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-16T15:40:13.898 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-16T15:40:13.898 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-16T15:40:13.899 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-11-16T15:40:13.988 INFO:teuthology.dispatcher.supervisor:Running job 6506519
2021-11-16T15:40:13.989 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-16_13:07:14-rados-wip-yuri4-testing-2021-11-15-1306-distro-basic-smithi/6506519 --name yuriw-2021-11-16_13:07:14-rados-wip-yuri4-testing-2021-11-15-1306-distro-basic-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2021-11-16_13:07:14-rados-wip-yuri4-testing-2021-11-15-1306-distro-basic-smithi/6506519/orig.config.yaml
2021-11-16T15:40:13.992 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-16_13:07:14-rados-wip-yuri4-testing-2021-11-15-1306-distro-basic-smithi/6506519
2021-11-16T15:40:13.993 INFO:teuthology.dispatcher.supervisor:Job PID: 9725
2021-11-16T15:40:13.993 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-17T03:41:08.003 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-17T03:41:08.214 INFO:teuthology.kill:Killing Pids: {9725}
2021-11-17T03:41:09.404 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-11-17T03:41:09.405 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-11-17T03:41:09.405 INFO:teuthology.misc:Compressing logs...
2021-11-17T03:41:09.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2021-11-17T03:41:09.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2021-11-17T03:41:09.644 INFO:teuthology.orchestra.run.smithi156.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-11-17T03:41:09.837 INFO:teuthology.orchestra.run.smithi183.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-11-17T03:41:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-11-17T03:41:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:tar: Error is not recoverable: exiting now
2021-11-17T03:41:09.912 INFO:teuthology.orchestra.run.smithi183.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-11-17T03:41:09.912 INFO:teuthology.orchestra.run.smithi183.stderr:tar: Error is not recoverable: exiting now
2021-11-17T03:41:09.913 INFO:teuthology.misc:Compressing logs...
2021-11-17T03:41:10.202 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-17T03:41:10.469 INFO:teuthology.misc:Compressing logs...
2021-11-17T03:41:10.884 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-17T03:41:11.297 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-17T03:41:11.702 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-mon.smithi156.log: file size changed while zipping
2021-11-17T03:41:11.992 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-17T03:41:12.416 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-17T03:41:32.192 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-11-17T03:41:42.065 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-mon.smithi183.log: file size changed while zipping
2021-11-17T03:42:06.633 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-17T03:43:09.008 INFO:teuthology.orchestra.run.smithi183.stderr:tar: ./f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.5.log-20211117: File removed before we read it
2021-11-17T03:43:09.023 INFO:teuthology.orchestra.run.smithi183.stderr:tar: ./f054ddb8-46f4-11ec-8c2c-001a4aab830c/ceph-osd.4.log-20211117: File removed before we read it
2021-11-17T03:43:21.196 INFO:teuthology.orchestra.run.smithi183.stderr:tar: ./f054ddb8-46f4-11ec-8c2c-001a4aab830c: file changed as we read it
2021-11-17T03:43:21.272 INFO:teuthology.kill:No teuthology processes running
2021-11-17T03:43:22.552 INFO:teuthology.kill:Nuking machines: ['smithi156', 'smithi183']
2021-11-17T03:43:23.614 INFO:teuthology.kill:2021-11-17 03:43:23,614.614 INFO:teuthology.nuke:targets:
2021-11-17T03:43:23.615 INFO:teuthology.kill:  smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJA8HJtujoE/frjjLMV0JXB2lcj1q4QvvH3bLlz62B7s8XlLQ582VTatiO0qIYeqnNit3JXCvbA7WbpCrNFY8y4KQI7zNAdfRGZcwOB8alcyVAzt4X9LDsx+0ZAgnOecC6L5ykMzj84oBwLNXIg1BD4DeGt6jP84RyikzeADaz10ykzSgn13qfBKhggXsCQKqJKtFQOEMg62bDBJr/iH353YYAmqB4gAzuEYqFiE8p5W1S1r487fXekH+SgfjGwcvfT6/yAduNO8VqhbEskSuCiHuT/MEEqFW+SlzvC64VfiAGvU7ucPzmcn570Tao8mhtmy3ftyz9gRvmHC/2VzWCet4hyTUwl4T+cPeZ1HGyPFFyECw3z8h+4Hdt9hNNtbdriTochT3lK63THjBvoOGu2E3bDbRoM5Ss3KdiZ0KB1jiJgzKioa8+sX2CiaEyg8z5OftaCewbZegc+nA1ounh32QUZowboYG4EtS6NJNL4oG+xOK1wg6mkmEZD2snztM=
2021-11-17T03:43:23.615 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfx/zuZotb3W8OWPhIKion4mVexEUAWvgQnBCNjPwuTsVr278/cKlqebfe/PKqfM0fuEy93Ov6RjfpLoRn8cpA//AAt1tyIa0DTlHHQ11KNSnTowk+IjZA5m22QrjcSlVvIb3C/UGgLNmyXMcXBESrybYDKI8mCDWQ6rmG5J6KBTcYdd0Bod4YfX5DtSlBDizBVasvuc5HaMt+RxUeTXsQMUo/3wuIqXdlNC6REx0DJJ7i+BHsMwoFFGBa72KuG5XLDCptIlkAkRkIJ1XWbkThUaNXlBr8K0SQCmTrETFmX0l8IZKFNjSFIm1zxzk5QrTIDXtkdTbiBMj04jlZ8Rz6uQDP61b5NpuWFLXM2HQXe7MszCzIyJa7WpIESY5/hS2dosN/kw9sIpGV6p6waB1YBOej2XYKwbXY3R9q7kqFoiwaSeeaIiRid3+vCY+1uXgQKRNd90HHqMfpJ+vNRt4XrE08m6ZxgasDLbNBdWH/g/glcuX+GzMbCtZ3KwdoSu0=
2021-11-17T03:43:23.653 INFO:teuthology.kill:2021-11-17 03:43:23,653.653 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-17T03:43:23.657 INFO:teuthology.kill:2021-11-17 03:43:23,657.657 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-17T03:43:23.740 INFO:teuthology.kill:2021-11-17 03:43:23,740.740 INFO:teuthology.orchestra.console:Power off smithi183
2021-11-17T03:43:23.756 INFO:teuthology.kill:2021-11-17 03:43:23,755.755 INFO:teuthology.orchestra.console:Power off smithi156
2021-11-17T03:43:32.120 INFO:teuthology.kill:2021-11-17 03:43:32,120.120 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-11-17T03:43:32.128 INFO:teuthology.kill:2021-11-17 03:43:32,128.128 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2021-11-17T03:43:32.267 INFO:teuthology.kill:2021-11-17 03:43:32,266.266 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2021-11-17T03:43:32.272 INFO:teuthology.kill:2021-11-17 03:43:32,272.272 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com
2021-11-17T03:45:32.593 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-17T03:45:32.690 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-16_20:03:49-rados-wip-yuri6-testing-2021-11-16-0926-pacific-distro-basic-smithi/6507859
2021-11-17T03:45:32.690 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-16_20:03:49-rados-wip-yuri6-testing-2021-11-16-0926-pacific-distro-basic-smithi/6507859