2021-12-24T21:46:51.446 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-24T21:46:51.564 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging
2021-12-24T21:46:51.565 INFO:teuthology.lock.ops:Updating [ubuntu@smithi180.front.sepia.ceph.com]: reset os type and version on server
2021-12-24T21:46:51.566 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server
2021-12-24T21:46:51.584 INFO:teuthology.lock.ops:Node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging is complete
2021-12-24T21:46:51.584 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging
2021-12-24T21:46:51.585 INFO:teuthology.lock.ops:Updating [ubuntu@smithi204.front.sepia.ceph.com]: reset os type and version on server
2021-12-24T21:46:51.585 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2021-12-24T21:46:51.610 INFO:teuthology.lock.ops:Node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging is complete
2021-12-24T21:46:51.819 INFO:teuthology.provision.fog.smithi180:Scheduling deploy of centos 8.stream
2021-12-24T21:46:51.844 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.stream
2021-12-24T21:46:52.244 INFO:teuthology.orchestra.console:Power off smithi180
2021-12-24T21:46:52.295 INFO:teuthology.orchestra.console:Power off smithi204
2021-12-24T21:47:00.657 INFO:teuthology.orchestra.console:Power off for smithi204 completed
2021-12-24T21:47:00.758 INFO:teuthology.orchestra.console:Power on smithi204
2021-12-24T21:47:04.740 INFO:teuthology.orchestra.console:Power off for smithi180 completed
2021-12-24T21:47:04.842 INFO:teuthology.orchestra.console:Power on smithi180
2021-12-24T21:47:09.096 INFO:teuthology.orchestra.console:Power on for smithi180 completed
2021-12-24T21:47:09.117 INFO:teuthology.orchestra.console:Power on for smithi204 completed
2021-12-24T21:47:09.198 INFO:teuthology.provision.fog.smithi180:Waiting for deploy to finish
2021-12-24T21:47:09.218 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish
2021-12-24T21:52:14.397 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-24T21:52:14.668 INFO:teuthology.provision.fog.smithi180:Node is ready
2021-12-24T21:52:14.685 INFO:teuthology.orchestra.run.smithi180.stdout:smithi180.front.sepia.ceph.com
2021-12-24T21:52:14.744 INFO:teuthology.orchestra.run.smithi180.stdout:172.21.15.180 smithi180.front.sepia.ceph.com smithi180
2021-12-24T21:52:15.094 INFO:teuthology.provision.fog.smithi180:Deploy complete!
2021-12-24T21:52:29.190 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-24T21:52:29.486 INFO:teuthology.provision.fog.smithi204:Node is ready
2021-12-24T21:52:29.513 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com
2021-12-24T21:52:29.580 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2021-12-24T21:52:29.938 INFO:teuthology.provision.fog.smithi204:Deploy complete!
2021-12-24T21:52:30.095 INFO:teuthology.lock.ops:Checking smithi180.front.sepia.ceph.com
2021-12-24T21:52:30.096 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-24T21:52:30.154 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com
2021-12-24T21:52:30.155 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-24T21:52:30.207 INFO:teuthology.lock.ops:Updating [smithi180.front.sepia.ceph.com]: set os type and version on server
2021-12-24T21:52:30.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi180.front.sepia.ceph.com'
2021-12-24T21:52:30.448 INFO:teuthology.orchestra.run.smithi180.stdout:x86_64
2021-12-24T21:52:30.504 INFO:teuthology.orchestra.run.smithi180.stdout:NAME="CentOS Stream"
2021-12-24T21:52:30.504 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION="8"
2021-12-24T21:52:30.505 INFO:teuthology.orchestra.run.smithi180.stdout:ID="centos"
2021-12-24T21:52:30.505 INFO:teuthology.orchestra.run.smithi180.stdout:ID_LIKE="rhel fedora"
2021-12-24T21:52:30.505 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_ID="8"
2021-12-24T21:52:30.505 INFO:teuthology.orchestra.run.smithi180.stdout:PLATFORM_ID="platform:el8"
2021-12-24T21:52:30.505 INFO:teuthology.orchestra.run.smithi180.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-24T21:52:30.506 INFO:teuthology.orchestra.run.smithi180.stdout:ANSI_COLOR="0;31"
2021-12-24T21:52:30.506 INFO:teuthology.orchestra.run.smithi180.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-24T21:52:30.506 INFO:teuthology.orchestra.run.smithi180.stdout:HOME_URL="https://centos.org/"
2021-12-24T21:52:30.506 INFO:teuthology.orchestra.run.smithi180.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-24T21:52:30.507 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-24T21:52:30.507 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-24T21:52:30.508 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server
2021-12-24T21:52:30.527 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server
2021-12-24T21:52:30.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2021-12-24T21:52:30.714 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64
2021-12-24T21:52:30.769 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream"
2021-12-24T21:52:30.770 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8"
2021-12-24T21:52:30.770 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos"
2021-12-24T21:52:30.770 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora"
2021-12-24T21:52:30.770 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8"
2021-12-24T21:52:30.770 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8"
2021-12-24T21:52:30.771 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-24T21:52:30.771 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31"
2021-12-24T21:52:30.771 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-24T21:52:30.771 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/"
2021-12-24T21:52:30.772 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-24T21:52:30.772 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-24T21:52:30.772 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-24T21:52:30.773 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2021-12-24T21:52:30.866 INFO:teuthology.dispatcher.supervisor:Running job 6583836
2021-12-24T21:52:30.866 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-12-24_15:50:35-rados-master-distro-basic-smithi/6583836 --name sage-2021-12-24_15:50:35-rados-master-distro-basic-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/sage-2021-12-24_15:50:35-rados-master-distro-basic-smithi/6583836/orig.config.yaml
2021-12-24T21:52:30.870 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-12-24_15:50:35-rados-master-distro-basic-smithi/6583836
2021-12-24T21:52:30.872 INFO:teuthology.dispatcher.supervisor:Job PID: 2151
2021-12-24T21:52:30.872 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-25T09:52:50.983 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-25T09:52:51.131 INFO:teuthology.kill:Killing Pids: {2151}
2021-12-25T09:52:52.284 INFO:teuthology.task.internal:roles: ubuntu@smithi180.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-25T09:52:52.285 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-25T09:52:52.285 INFO:teuthology.misc:Compressing logs...
2021-12-25T09:52:52.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi180.front.sepia.ceph.com'
2021-12-25T09:52:52.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2021-12-25T09:52:52.528 INFO:teuthology.orchestra.run.smithi180.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-25T09:52:52.720 INFO:teuthology.orchestra.run.smithi204.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-25T09:52:52.766 INFO:teuthology.orchestra.run.smithi180.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-25T09:52:52.766 INFO:teuthology.orchestra.run.smithi180.stderr:tar: Error is not recoverable: exiting now
2021-12-25T09:52:52.990 INFO:teuthology.orchestra.run.smithi204.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-25T09:52:52.990 INFO:teuthology.orchestra.run.smithi204.stderr:tar: Error is not recoverable: exiting now
2021-12-25T09:52:52.992 INFO:teuthology.misc:Compressing logs...
2021-12-25T09:52:53.240 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-25T09:52:53.554 INFO:teuthology.misc:Compressing logs...
2021-12-25T09:53:04.097 INFO:teuthology.orchestra.run.smithi180.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-25T09:53:04.207 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-25T09:53:13.397 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-25T09:53:13.954 INFO:teuthology.orchestra.run.smithi180.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-25T09:53:15.535 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-mgr.smithi204.gvxjmo.log: file size changed while zipping
2021-12-25T09:53:21.298 INFO:teuthology.orchestra.run.smithi180.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-25T09:53:25.999 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-25T09:53:32.025 INFO:teuthology.orchestra.run.smithi180.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-25T09:53:34.614 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-25T09:53:39.819 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-mon.smithi204.log: file size changed while zipping
2021-12-25T09:53:42.539 INFO:teuthology.orchestra.run.smithi180.stderr:gzip: /var/log/ceph/8246b43a-6504-11ec-8c31-001a4aab830c/ceph-mon.smithi180.log: file size changed while zipping
2021-12-25T09:54:30.923 INFO:teuthology.kill:No teuthology processes running
2021-12-25T09:54:32.100 INFO:teuthology.kill:Nuking machines: ['smithi180', 'smithi204']
2021-12-25T09:54:33.068 INFO:teuthology.kill:2021-12-25 09:54:33,068.068 INFO:teuthology.nuke:targets:
2021-12-25T09:54:33.069 INFO:teuthology.kill:  smithi180.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdGS38/AWuSc22h9AbiH1jkqPkp/7zUqrmovX0gsSVTPjRIHYAs3NqLAm5nxKnNjo0caKON4Fy+dgpEisVdui/4WzGzFtHALE02+S2zRN6gmF4sh3uL0iEqz2vFxBLyWHb4hZg8hrQL9Q3UQzw5c9YzFLzR3oJuT81c5RUVCBoeaTuMkRP18DchIS92upLk5ACFF2U04C+Ms23qblCPRGW6gppsqSZyEVmpdoEwHSe145KGwLPtqHxFfcNnjOMp1ulpT4MU3R6UFY3qroKGGqPj2PQwEsnBD7RKSuFPD8ByI0pGvNx2RWZH6+5Ipe8pUJyuKdugeeejYcx0LjqZLrjqdTRkez4T+ojjieaCgDCK+h+eei9pQzMk0GFqD2ytLk7kZqKsn+aexXU0+lp7SfGsC9Z8iu+NjbQBpUljdqvybHnmoVqtv6JLra8CPC/lGsW1PZQdRwX7kuUU9LJnxPiNGYTnvA3l4QGiVWjXcyJDqFFU2kVCAcfJDz90iHnbBc=
2021-12-25T09:54:33.070 INFO:teuthology.kill:  smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Qatr+Mcsy3waJDrOJTxUBHTfnRgiG6YspYX0ETQMAJaZ5W5SbcGdOfUSHVLNDjEfTCBU8p0RJpaUDdEjktU9bJ47+8bliaN1O2019zsPNGeUtDnWl86ebGq6dT2TKUYKsS5UeYe600DaY2d1yRNyYQ1RaMl/qR9vDTp3XejGRLeqMjfVuYGsQPmvOv8WvAtjoSzzbw/Uj6boB71JXcBfUWLg8M93MDD4j+8vVz5mDYRIUlBPTWFH0EJRClNCrTvCCszr70DG2uqW401TVBlz+ViCS3ps9/CMS9nZUkotw7kwyXuYw72mRt4kFCY4zS4yPot3cRDUytRydG4T8vqP/KUSxAxyJSFrgNEAewHsLSOQHYDYF9JETqsvjazRSYubPmwcHeT9wq2NgjGGGXuSZ6KZ8Lqf4ZJkalii1XWIFA7+edgiHHR1JVdtednYcyT6yXDCQI9W+AZ5c5UIPZ8P+88ZQR6kDRSB8D/n/utNAUDcf1cwKA7ThkyJCt0lud8=
2021-12-25T09:54:33.095 INFO:teuthology.kill:2021-12-25 09:54:33,094.094 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-25T09:54:33.098 INFO:teuthology.kill:2021-12-25 09:54:33,098.098 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-25T09:54:33.177 INFO:teuthology.kill:2021-12-25 09:54:33,177.177 INFO:teuthology.orchestra.console:Power off smithi180
2021-12-25T09:54:33.193 INFO:teuthology.kill:2021-12-25 09:54:33,193.193 INFO:teuthology.orchestra.console:Power off smithi204
2021-12-25T09:54:45.665 INFO:teuthology.kill:2021-12-25 09:54:45,665.665 INFO:teuthology.orchestra.console:Power off for smithi180 completed
2021-12-25T09:54:45.669 INFO:teuthology.kill:2021-12-25 09:54:45,669.669 INFO:teuthology.orchestra.console:Power off for smithi204 completed
2021-12-25T09:54:45.819 INFO:teuthology.kill:2021-12-25 09:54:45,818.818 INFO:teuthology.lock.ops:unlocked: smithi180.front.sepia.ceph.com
2021-12-25T09:54:45.823 INFO:teuthology.kill:2021-12-25 09:54:45,823.823 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com
2021-12-25T09:56:46.128 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-25T09:56:46.222 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi180 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-21_05:15:02-krbd-octopus-testing-default-smithi/6574731
2021-12-25T09:56:46.222 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi204 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-21_05:15:02-krbd-octopus-testing-default-smithi/6574731