2022-03-02T03:37:58.714 INFO:root:teuthology version: 1.1.0-cb5b1a75
2022-03-02T03:37:58.840 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging
2022-03-02T03:37:58.842 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server
2022-03-02T03:37:58.842 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2022-03-02T03:37:58.867 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete
2022-03-02T03:37:58.867 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging
2022-03-02T03:37:58.868 INFO:teuthology.lock.ops:Updating [ubuntu@smithi179.front.sepia.ceph.com]: reset os type and version on server
2022-03-02T03:37:58.868 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2022-03-02T03:37:58.890 INFO:teuthology.lock.ops:Node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging is complete
2022-03-02T03:37:59.110 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream
2022-03-02T03:37:59.115 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream
2022-03-02T03:37:59.490 INFO:teuthology.orchestra.console:Power off smithi131
2022-03-02T03:37:59.506 INFO:teuthology.orchestra.console:Power off smithi179
2022-03-02T03:38:11.976 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2022-03-02T03:38:11.982 INFO:teuthology.orchestra.console:Power off for smithi179 completed
2022-03-02T03:38:12.078 INFO:teuthology.orchestra.console:Power on smithi131
2022-03-02T03:38:12.086 INFO:teuthology.orchestra.console:Power on smithi179
2022-03-02T03:38:16.333 INFO:teuthology.orchestra.console:Power on for smithi131 completed
2022-03-02T03:38:16.434 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2022-03-02T03:38:20.528 INFO:teuthology.orchestra.console:Power on for smithi179 completed
2022-03-02T03:38:20.629 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2022-03-02T03:42:48.314 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-02T03:42:48.570 INFO:teuthology.provision.fog.smithi131:Node is ready
2022-03-02T03:42:48.587 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2022-03-02T03:42:48.646 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2022-03-02T03:42:48.983 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2022-03-02T03:42:52.397 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-02T03:42:52.647 INFO:teuthology.provision.fog.smithi179:Node is ready
2022-03-02T03:42:52.665 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2022-03-02T03:42:52.724 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2022-03-02T03:42:53.066 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2022-03-02T03:42:53.214 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2022-03-02T03:42:53.215 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-02T03:42:53.239 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2022-03-02T03:42:53.239 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-02T03:42:53.266 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2022-03-02T03:42:53.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2022-03-02T03:42:53.466 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2022-03-02T03:42:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2022-03-02T03:42:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8"
2022-03-02T03:42:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2022-03-02T03:42:53.526 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2022-03-02T03:42:53.526 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8"
2022-03-02T03:42:53.526 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2022-03-02T03:42:53.526 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-02T03:42:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2022-03-02T03:42:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-02T03:42:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2022-03-02T03:42:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-02T03:42:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-02T03:42:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-02T03:42:53.529 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2022-03-02T03:42:53.546 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2022-03-02T03:42:53.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2022-03-02T03:42:53.736 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2022-03-02T03:42:53.794 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream"
2022-03-02T03:42:53.794 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8"
2022-03-02T03:42:53.794 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos"
2022-03-02T03:42:53.794 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora"
2022-03-02T03:42:53.795 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8"
2022-03-02T03:42:53.795 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2022-03-02T03:42:53.795 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-02T03:42:53.795 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2022-03-02T03:42:53.796 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-02T03:42:53.796 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/"
2022-03-02T03:42:53.796 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-02T03:42:53.796 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-02T03:42:53.797 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-02T03:42:53.797 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2022-03-02T03:42:53.892 INFO:teuthology.dispatcher.supervisor:Running job 6714847
2022-03-02T03:42:53.892 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6714847 --name yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6714847/orig.config.yaml
2022-03-02T03:42:53.896 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6714847
2022-03-02T03:42:53.897 INFO:teuthology.dispatcher.supervisor:Job PID: 13342
2022-03-02T03:42:53.897 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-02T10:13:23.369 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-02T10:13:25.334 INFO:teuthology.kill:Killing Pids: {13342}
2022-03-02T10:13:26.682 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-02T10:13:26.683 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-02T10:13:26.684 INFO:teuthology.misc:Compressing logs...
2022-03-02T10:13:26.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2022-03-02T10:13:26.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2022-03-02T10:13:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-02T10:13:27.123 INFO:teuthology.orchestra.run.smithi179.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-02T10:13:27.163 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-02T10:13:27.164 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now
2022-03-02T10:13:27.201 INFO:teuthology.orchestra.run.smithi179.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-02T10:13:27.201 INFO:teuthology.orchestra.run.smithi179.stderr:tar: Error is not recoverable: exiting now
2022-03-02T10:13:27.203 INFO:teuthology.misc:Compressing logs...
2022-03-02T10:13:27.612 INFO:teuthology.misc:Compressing logs...
2022-03-02T10:13:31.898 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-mon.smithi179.log: file size changed while zipping
2022-03-02T10:13:32.647 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-mgr.smithi179.chjkfa.log: file size changed while zipping
2022-03-02T10:13:39.805 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-mon.smithi131.log: file size changed while zipping
2022-03-02T10:13:49.567 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-02T10:13:55.887 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-02T10:14:06.844 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-02T10:14:10.497 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-02T10:14:24.865 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-02T10:14:24.939 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-02T10:14:26.669 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-mgr.smithi131.ezkaxt.log: file size changed while zipping
2022-03-02T10:14:40.905 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-02T10:14:44.637 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ea5525c8-99db-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-02T10:15:16.030 INFO:teuthology.kill:No teuthology processes running
2022-03-02T10:15:17.235 INFO:teuthology.kill:Nuking machines: ['smithi131', 'smithi179']
2022-03-02T10:15:18.174 INFO:teuthology.kill:2022-03-02 10:15:18,174.174 INFO:teuthology.nuke:targets:
2022-03-02T10:15:18.175 INFO:teuthology.kill:  smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC436xy8ByBTCVu4L8AHzF08Xd/94Xu1CTPG1nl3xI2UeKDCstXm21vz6qREtuExqXq1g1GllWoHlufnwiuXCOdRZNB0JkyN8hvzHR3LMPGo3vVP1pBRihGhOMIOkW4Sj2JfGtFrHeJNVu5Bu4SapslkHCpwiUWkzELd98t7R/wnJQY2VhWolIz59sy1fJWuNs6m5WQ+niGJYyCl0T+yj2vXSA5LREZ1UZgwSiF8VimLfhvJx/CnCln8ZhxDQLbic77vlU3Hp4CQzC1JIMAPzESm2j/U5+E63JSzJkXP6K70at/tIw4SV4Fy7jklE5PolcQwZElqOeENogkJz3RFvuOV25ZMf/66G1955dC3vNiCERx0SxL3cnac1TM+nOL83Fim1Z9L0EudvzAgoXJTvso+5vqne6udq3kNW5770ffu3v95J8Lp2waXQJZLGTebBhyUMQ5BaP+Xve8zI2cbeJZb9vurPoyVTDHUcYZexgMRZqAU4ybB+r/gUWb5s5AP1M=
2022-03-02T10:15:18.175 INFO:teuthology.kill:  smithi179.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/BVcJ6d5TmjSbU5r9z7uAQCMEE44CNmusXdZlGYEwrjGPh3iLI9YadBuZQCgoiftvr69RxJfu8nRB9pE4ktT8pRRgN+PZeoQP9zKTWIWJ7xnV+GkOLXRDnwqdmZ5/j/UdCDprIS5NtCRYy9Di/0ojRidOd6zgeN0KBGLSjmC19fmzMOyJUeZLatJejxBd+rkN+q5nVF1+CLn1MqPqZYiQu/NaukTLj+0q3ppqEAc202r9B0fQEiFrhn32z930oDR7dlZEVpLjeiKPMvqvkfXbY9tTiC8DqLPTolHIHNuhx9i2Vik8Rmv+vCw5Hrz7ZFoJx3rUzZv65vSjCLo/eNWY0XfrvNEe3G6gtKh/0sxAO4QRVvxQf7OHRNWf5w67bGghrbPFMB5xcy7DOZxHH2DAP5ajZa1Tq9NIEDdsqWfm8ynyUpfnIzUW28MDUOFbkaW3U1QwPLlnGJGXhZULStI8qTXCXZ/yPLLqAILTB2t3qcoBvvB3yseitHkcGSZovn8=
2022-03-02T10:15:18.205 INFO:teuthology.kill:2022-03-02 10:15:18,205.205 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-02T10:15:18.207 INFO:teuthology.kill:2022-03-02 10:15:18,207.207 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-02T10:15:18.296 INFO:teuthology.kill:2022-03-02 10:15:18,295.295 INFO:teuthology.orchestra.console:Power off smithi131
2022-03-02T10:15:18.310 INFO:teuthology.kill:2022-03-02 10:15:18,310.310 INFO:teuthology.orchestra.console:Power off smithi179
2022-03-02T10:15:26.665 INFO:teuthology.kill:2022-03-02 10:15:26,665.665 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2022-03-02T10:15:26.812 INFO:teuthology.kill:2022-03-02 10:15:26,812.812 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2022-03-02T10:15:30.783 INFO:teuthology.kill:2022-03-02 10:15:30,782.782 INFO:teuthology.orchestra.console:Power off for smithi179 completed
2022-03-02T10:15:30.936 INFO:teuthology.kill:2022-03-02 10:15:30,935.935 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com
2022-03-02T10:17:31.244 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-02T10:17:31.350 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-01_04:17:02-fs-pacific-distro-default-smithi/6713390
2022-03-02T10:17:31.351 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi179 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-01_04:17:02-fs-pacific-distro-default-smithi/6713391