2021-12-22T10:04:17.407 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-22T10:04:17.532 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi052.front.sepia.ceph.com' reimaging
2021-12-22T10:04:17.533 INFO:teuthology.lock.ops:Updating [ubuntu@smithi052.front.sepia.ceph.com]: reset os type and version on server
2021-12-22T10:04:17.533 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2021-12-22T10:04:17.552 INFO:teuthology.lock.ops:Node 'ubuntu@smithi052.front.sepia.ceph.com' reimaging is complete
2021-12-22T10:04:17.552 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging
2021-12-22T10:04:17.553 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server
2021-12-22T10:04:17.553 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2021-12-22T10:04:17.572 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete
2021-12-22T10:04:17.766 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.stream
2021-12-22T10:04:17.769 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 8.stream
2021-12-22T10:04:18.164 INFO:teuthology.orchestra.console:Power off smithi052
2021-12-22T10:04:18.179 INFO:teuthology.orchestra.console:Power off smithi197
2021-12-22T10:04:18.309 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2021-12-22T10:04:18.318 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2021-12-22T10:04:18.410 INFO:teuthology.orchestra.console:Power on smithi052
2021-12-22T10:04:18.419 INFO:teuthology.orchestra.console:Power on smithi197
2021-12-22T10:04:22.669 INFO:teuthology.orchestra.console:Power on for smithi052 completed
2021-12-22T10:04:22.673 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2021-12-22T10:04:22.771 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2021-12-22T10:04:22.775 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2021-12-22T10:06:55.432 ERROR:teuthology.orchestra.connection:Error authenticating with smithi197.front.sepia.ceph.com: Authentication failed.
2021-12-22T10:08:05.326 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-22T10:08:25.652 INFO:teuthology.provision.fog.smithi052:Node is ready
2021-12-22T10:08:25.674 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2021-12-22T10:08:25.734 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2021-12-22T10:08:26.087 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2021-12-22T10:09:27.328 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-22T10:09:27.612 INFO:teuthology.provision.fog.smithi197:Node is ready
2021-12-22T10:09:27.631 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2021-12-22T10:09:27.692 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2021-12-22T10:09:28.062 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2021-12-22T10:09:28.220 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2021-12-22T10:09:28.221 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-22T10:09:28.241 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2021-12-22T10:09:28.242 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-22T10:09:28.260 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2021-12-22T10:09:28.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2021-12-22T10:09:28.515 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2021-12-22T10:09:28.572 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2021-12-22T10:09:28.573 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8"
2021-12-22T10:09:28.573 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2021-12-22T10:09:28.573 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2021-12-22T10:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8"
2021-12-22T10:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2021-12-22T10:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-22T10:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2021-12-22T10:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-22T10:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2021-12-22T10:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-22T10:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-22T10:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-22T10:09:28.577 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2021-12-22T10:09:28.595 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2021-12-22T10:09:28.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2021-12-22T10:09:28.786 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2021-12-22T10:09:28.843 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Stream"
2021-12-22T10:09:28.843 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8"
2021-12-22T10:09:28.843 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos"
2021-12-22T10:09:28.844 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora"
2021-12-22T10:09:28.844 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8"
2021-12-22T10:09:28.844 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8"
2021-12-22T10:09:28.844 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-22T10:09:28.844 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31"
2021-12-22T10:09:28.845 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-22T10:09:28.845 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://centos.org/"
2021-12-22T10:09:28.845 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-22T10:09:28.845 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-22T10:09:28.845 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-22T10:09:28.846 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2021-12-22T10:09:28.939 INFO:teuthology.dispatcher.supervisor:Running job 6575252
2021-12-22T10:09:28.940 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2021-12-21_07:21:04-rados-wip-primary-balancer-distro-default-smithi/6575252 --name lflores-2021-12-21_07:21:04-rados-wip-primary-balancer-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/lflores-2021-12-21_07:21:04-rados-wip-primary-balancer-distro-default-smithi/6575252/orig.config.yaml
2021-12-22T10:09:28.944 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2021-12-21_07:21:04-rados-wip-primary-balancer-distro-default-smithi/6575252
2021-12-22T10:09:28.945 INFO:teuthology.dispatcher.supervisor:Job PID: 6495
2021-12-22T10:09:28.945 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-22T22:09:49.410 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-22T22:09:49.598 INFO:teuthology.kill:Killing Pids: {6495}
2021-12-22T22:09:50.768 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-22T22:09:50.769 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-22T22:09:50.769 INFO:teuthology.misc:Compressing logs...
2021-12-22T22:09:50.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2021-12-22T22:09:50.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2021-12-22T22:09:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-22T22:09:51.204 INFO:teuthology.orchestra.run.smithi197.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-22T22:09:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-22T22:09:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now
2021-12-22T22:09:51.292 INFO:teuthology.orchestra.run.smithi197.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-22T22:09:51.293 INFO:teuthology.orchestra.run.smithi197.stderr:tar: Error is not recoverable: exiting now
2021-12-22T22:09:51.294 INFO:teuthology.misc:Compressing logs...
2021-12-22T22:09:51.692 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-22T22:09:51.893 INFO:teuthology.misc:Compressing logs...
2021-12-22T22:09:56.178 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-mgr.smithi197.uxncgc.log: file size changed while zipping
2021-12-22T22:10:13.010 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-mon.smithi052.log: file size changed while zipping
2021-12-22T22:10:25.961 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-22T22:10:40.900 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-22T22:10:50.649 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-22T22:11:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-22T22:11:15.915 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-22T22:11:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-22T22:11:37.833 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-22T22:11:47.895 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-mon.smithi197.log: file size changed while zipping
2021-12-22T22:11:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/ff54a708-630f-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-22T22:12:39.455 INFO:teuthology.kill:No teuthology processes running
2021-12-22T22:12:40.665 INFO:teuthology.kill:Nuking machines: ['smithi052', 'smithi197']
2021-12-22T22:12:41.737 INFO:teuthology.kill:2021-12-22 22:12:41,737.737 INFO:teuthology.nuke:targets:
2021-12-22T22:12:41.738 INFO:teuthology.kill:  smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCetX/CGW6EEQkScNrEit8kj/pK86sQIlaV98mvzL3ICAZozesEdp5NespwmL45ZIFJGEepQyx4smSE5WayuK2f3gE4ZfUCf1Wy0Uh05FiQUtKz321cG4JKMSkJkS46oWJPY2XeOsD5cRVllgbKY6m3S1UWxdhkVJf2UCeRd6po/sB4M9MZJrm4D+QYz0YnymHeMS7m6FV0LYBljtzpSfraFc7uV4I/rb/UciBzfJmZA8ayFYtu1TlWaTs1Yd5yuXj4U8oWn9EfMNux+20w5WLX7pBZUoxZAxrHfnrvcdYmD0YV008W62U+u7mdvb60X9BYnajvedoh8+34osZRpqlOwoaPeS8pLyy+h+OaIwCn2xfoRPiwohWZQyKfpbA9ASF7EdWFvxipfzKGv2Dye82o/QqFWv2KfHA8P96iOO/1E5Z1nW40UyAijONgA+R3OSbtPeVATPbwo/xab+g85YyfUaWZZE1Hfrzex6A7VUyr2adslP7p0TmJ+khm0Is1lok=
2021-12-22T22:12:41.739 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFTGF2Eb43fgEkekPCOmM+Kew0Rpu7iqxbqa/fi3tzyPpapm0/czTJ7R1g+6LMHCC65s8s9iLjqMwAS6yDwE6hCyxIAM9+UsUDaLpyKhiKwWAjNh/m5FoMnwlIF3aIhuJcB2InPMTdXuTZd+dOJ+s0yOJl4Tv1BpFO6TJ5e3sJbj/uElxAsl0NsF0M9d8kQo1PNVHdl8mwkGPIMPb1sBAyLK8jTr1stvBcA4yvEzJSXQ0edBg/q7XtMJS2xomHKmrZ0WEW5IDc26qcZZtA8HV3+PkazswKmmzGRf1uce3rkqG0GcHYO0XkdecbvAfV6Ls3GLcLluWpyda9ob2YxDlfLIqoz9QhXTbkH4XnWn30oqtobeVpwbxe+Fk4R6cwVsuwHPu2+Bdt+hbOYtJnH7+z6WQdIEAUOJkRp4YXdsyYJhdCiYZN/8tFuOjb5SE3TGoqBqZBAnmT8QGtggjU0s183sbgVNKDt+LNgOvERlnPZgaRBfeKA0mzf5vCMPkDCv0=
2021-12-22T22:12:41.766 INFO:teuthology.kill:2021-12-22 22:12:41,766.766 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-22T22:12:41.771 INFO:teuthology.kill:2021-12-22 22:12:41,771.771 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-22T22:12:41.860 INFO:teuthology.kill:2021-12-22 22:12:41,860.860 INFO:teuthology.orchestra.console:Power off smithi052
2021-12-22T22:12:41.877 INFO:teuthology.kill:2021-12-22 22:12:41,877.877 INFO:teuthology.orchestra.console:Power off smithi197
2021-12-22T22:12:54.352 INFO:teuthology.kill:2021-12-22 22:12:54,352.352 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2021-12-22T22:12:54.358 INFO:teuthology.kill:2021-12-22 22:12:54,358.358 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2021-12-22T22:12:54.507 INFO:teuthology.kill:2021-12-22 22:12:54,506.506 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com
2021-12-22T22:12:54.510 INFO:teuthology.kill:2021-12-22 22:12:54,510.510 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com
2021-12-22T22:14:54.739 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-22T22:14:54.839 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi052 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-22_18:10:35-rados-wip-yuri10-testing-2021-12-22-0751-distro-default-smithi/6579953
2021-12-22T22:14:54.840 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-22_18:10:35-rados-wip-yuri10-testing-2021-12-22-0751-distro-default-smithi/6579953