2022-01-31T17:20:16.120 INFO:root:teuthology version: 1.1.0-7c0cb867
2022-01-31T17:20:16.270 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging
2022-01-31T17:20:16.271 INFO:teuthology.lock.ops:Updating [ubuntu@smithi023.front.sepia.ceph.com]: reset os type and version on server
2022-01-31T17:20:16.272 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-01-31T17:20:16.294 INFO:teuthology.lock.ops:Node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging is complete
2022-01-31T17:20:16.294 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging
2022-01-31T17:20:16.294 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server
2022-01-31T17:20:16.295 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server
2022-01-31T17:20:16.315 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete
2022-01-31T17:20:16.523 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream
2022-01-31T17:20:16.541 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of centos 8.stream
2022-01-31T17:20:16.912 INFO:teuthology.orchestra.console:Power off smithi023
2022-01-31T17:20:16.926 INFO:teuthology.orchestra.console:Power off smithi036
2022-01-31T17:20:25.305 INFO:teuthology.orchestra.console:Power off for smithi036 completed
2022-01-31T17:20:25.406 INFO:teuthology.orchestra.console:Power on smithi036
2022-01-31T17:20:29.411 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-01-31T17:20:29.512 INFO:teuthology.orchestra.console:Power on smithi023
2022-01-31T17:20:33.769 INFO:teuthology.orchestra.console:Power on for smithi036 completed
2022-01-31T17:20:33.871 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish
2022-01-31T17:20:37.878 INFO:teuthology.orchestra.console:Power on for smithi023 completed
2022-01-31T17:20:37.979 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2022-01-31T17:24:10.280 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-31T17:24:30.611 INFO:teuthology.provision.fog.smithi036:Node is ready
2022-01-31T17:24:30.633 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com
2022-01-31T17:24:30.692 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036
2022-01-31T17:24:31.042 INFO:teuthology.provision.fog.smithi036:Deploy complete!
2022-01-31T17:25:57.968 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-31T17:25:58.256 INFO:teuthology.provision.fog.smithi023:Node is ready
2022-01-31T17:25:58.274 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2022-01-31T17:25:58.333 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2022-01-31T17:25:58.670 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2022-01-31T17:25:58.843 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2022-01-31T17:25:58.843 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-31T17:25:58.866 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com
2022-01-31T17:25:58.867 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-31T17:25:58.885 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2022-01-31T17:25:58.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-01-31T17:25:59.082 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2022-01-31T17:25:59.140 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream"
2022-01-31T17:25:59.140 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8"
2022-01-31T17:25:59.141 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos"
2022-01-31T17:25:59.141 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora"
2022-01-31T17:25:59.141 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8"
2022-01-31T17:25:59.141 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2022-01-31T17:25:59.142 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-31T17:25:59.142 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2022-01-31T17:25:59.142 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-31T17:25:59.142 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/"
2022-01-31T17:25:59.143 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-31T17:25:59.143 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-31T17:25:59.143 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-31T17:25:59.144 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-01-31T17:25:59.166 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server
2022-01-31T17:25:59.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com'
2022-01-31T17:25:59.414 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64
2022-01-31T17:25:59.472 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="CentOS Stream"
2022-01-31T17:25:59.472 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8"
2022-01-31T17:25:59.472 INFO:teuthology.orchestra.run.smithi036.stdout:ID="centos"
2022-01-31T17:25:59.473 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="rhel fedora"
2022-01-31T17:25:59.473 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8"
2022-01-31T17:25:59.473 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8"
2022-01-31T17:25:59.473 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-31T17:25:59.474 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31"
2022-01-31T17:25:59.474 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-31T17:25:59.474 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://centos.org/"
2022-01-31T17:25:59.474 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-31T17:25:59.474 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-31T17:25:59.475 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-31T17:25:59.475 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server
2022-01-31T17:25:59.580 INFO:teuthology.dispatcher.supervisor:Running job 6650643
2022-01-31T17:25:59.581 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-31_16:06:23-rados-wip-yuri5-testing-2022-01-30-1200-pacific-distro-default-smithi/6650643 --name yuriw-2022-01-31_16:06:23-rados-wip-yuri5-testing-2022-01-30-1200-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-01-31_16:06:23-rados-wip-yuri5-testing-2022-01-30-1200-pacific-distro-default-smithi/6650643/orig.config.yaml
2022-01-31T17:25:59.585 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-31_16:06:23-rados-wip-yuri5-testing-2022-01-30-1200-pacific-distro-default-smithi/6650643
2022-01-31T17:25:59.586 INFO:teuthology.dispatcher.supervisor:Job PID: 30375
2022-01-31T17:25:59.586 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-31T23:56:28.766 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-31T23:56:28.945 INFO:teuthology.kill:Killing Pids: {30375}
2022-01-31T23:56:30.195 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-31T23:56:30.196 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-31T23:56:30.196 INFO:teuthology.misc:Compressing logs...
2022-01-31T23:56:30.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-01-31T23:56:30.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com'
2022-01-31T23:56:30.444 INFO:teuthology.orchestra.run.smithi023.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-31T23:56:30.682 INFO:teuthology.orchestra.run.smithi036.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-31T23:56:30.725 INFO:teuthology.orchestra.run.smithi023.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-31T23:56:30.725 INFO:teuthology.orchestra.run.smithi023.stderr:tar: Error is not recoverable: exiting now
2022-01-31T23:56:30.770 INFO:teuthology.orchestra.run.smithi036.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-31T23:56:30.771 INFO:teuthology.orchestra.run.smithi036.stderr:tar: Error is not recoverable: exiting now
2022-01-31T23:56:30.772 INFO:teuthology.misc:Compressing logs...
2022-01-31T23:56:31.060 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-31T23:56:31.233 INFO:teuthology.misc:Compressing logs...
2022-01-31T23:56:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-mon.smithi023.log: file size changed while zipping
2022-01-31T23:56:47.730 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-mgr.smithi023.zrijwy.log: file size changed while zipping
2022-01-31T23:57:04.606 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-31T23:57:14.313 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-31T23:57:31.347 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-31T23:57:38.135 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-31T23:57:54.053 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-31T23:57:54.832 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-31T23:58:16.431 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-31T23:58:20.123 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-mon.smithi036.log: file size changed while zipping
2022-01-31T23:58:21.480 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/07195828-82bc-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-31T23:58:43.980 INFO:teuthology.orchestra.run.smithi023.stderr:tar: .: file changed as we read it
2022-01-31T23:59:05.016 INFO:teuthology.kill:No teuthology processes running
2022-01-31T23:59:06.295 INFO:teuthology.kill:Nuking machines: ['smithi023', 'smithi036']
2022-01-31T23:59:07.356 INFO:teuthology.kill:2022-01-31 23:59:07,355.355 INFO:teuthology.nuke:targets:
2022-01-31T23:59:07.357 INFO:teuthology.kill:  smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMI5X0m5Otvnuy0TrkWZRNdDsETaJkvB7X3buGpSLvU9rQRp3AsfqpNkLenDv4zSRun1IFmg63r8RLhQQ5HDj5ImknJjAfAaufCR3AvjLRLpRKrY32vnkH7U7TFBD3Uzqq3Dz2Qdb3j+a+JTlKNrG5moESCnf3Q4agIGZerwVAQgeGY50PIg8+nuK4NSm9mu696i9lxn7aQLNwr6HYLc8DbcaAinX9lsh6oa5W5ZRtmjBL+OBaXVWd9yl7IgG/5FJ89Djt6W7Ys3s4OkCJG9ibbmO/23vzoFSVUaOeDqYZ4S8uc+ZBmtL7Wk9s59Ie8TY7q2vzI5w4VAgMsImc0LiUgkn6hT5eVA64BtWUfKqLB8556sMolnbTFqUp36KmIntA3b6z2I6rVQ9bvxum0oDPlqh664q9qjHtJMbArK7LL9rcgDxaF9dmN9zMu8WF5+B6lWSvUzXeqmtJWuhUC1KTw4JvJPJ6Nwb1Af3u1e9/9torN+tnCzTTGNW78CTFqkk=
2022-01-31T23:59:07.357 INFO:teuthology.kill:  smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq7L2khxoO8R0YEASxAnhGZzmgFY4yrx0MOIc/JUydND5e3QrbdyL7d1+Y3WnRRAaW34w/OZuk0ifqayEChl4GdICa6gc6jRGOuZTELEG9mqZfho0M+IiQ+hc8EnP4B0mHbACTbdMcPKpcsVN0rbuJdpui5AQD6OfrIDl3MMRO7yV24zmZ+NXwDXvXYxyuc8w9drSCZTm2DRPbEt/fYU1sbSGsZ93UdEhQluqBOlNRK+o5QEtgQvmlhuLVN8DyDeGjcjeJja7ryeym5s5GxNEJmNwvJWXub+5E8IT3/PeSKHJueEAT7Ue+rH35ZcBNOA4nKAr+pTVF6RzUVNGR6dMaw90OGHfaU/nq09C00am+YrqiCievM5KVhPnWlX2/GpuKBE8O0kshy0zTbWPBdTd94Fk8g+4qX0aCjwBRNAgtFh7Ak77U09rADKGL6IgLRw5+zgyMyWWmX1R1uzMit+GGQfksSljEDViiBxYeB5AMCp2wtCoR9sIsfwNV8voj9RU=
2022-01-31T23:59:07.384 INFO:teuthology.kill:2022-01-31 23:59:07,384.384 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-31T23:59:07.393 INFO:teuthology.kill:2022-01-31 23:59:07,393.393 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-31T23:59:07.466 INFO:teuthology.kill:2022-01-31 23:59:07,466.466 INFO:teuthology.orchestra.console:Power off smithi036
2022-01-31T23:59:07.480 INFO:teuthology.kill:2022-01-31 23:59:07,480.480 INFO:teuthology.orchestra.console:Power off smithi023
2022-01-31T23:59:15.954 INFO:teuthology.kill:2022-01-31 23:59:15,953.953 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-01-31T23:59:16.106 INFO:teuthology.kill:2022-01-31 23:59:16,105.105 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com
2022-01-31T23:59:20.026 INFO:teuthology.kill:2022-01-31 23:59:20,025.025 INFO:teuthology.orchestra.console:Power off for smithi036 completed
2022-01-31T23:59:20.178 INFO:teuthology.kill:2022-01-31 23:59:20,178.178 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com
2022-02-01T00:01:20.495 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15