2021-12-10T18:18:17.711 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-10T18:18:17.835 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging
2021-12-10T18:18:17.836 INFO:teuthology.lock.ops:Updating [ubuntu@smithi023.front.sepia.ceph.com]: reset os type and version on server
2021-12-10T18:18:17.836 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2021-12-10T18:18:17.854 INFO:teuthology.lock.ops:Node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging is complete
2021-12-10T18:18:17.854 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging
2021-12-10T18:18:17.855 INFO:teuthology.lock.ops:Updating [ubuntu@smithi190.front.sepia.ceph.com]: reset os type and version on server
2021-12-10T18:18:17.855 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2021-12-10T18:18:17.874 INFO:teuthology.lock.ops:Node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging is complete
2021-12-10T18:18:18.067 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream
2021-12-10T18:18:18.079 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.stream
2021-12-10T18:18:18.388 INFO:teuthology.orchestra.console:Power off smithi023
2021-12-10T18:18:18.426 INFO:teuthology.orchestra.console:Power off smithi190
2021-12-10T18:18:26.763 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2021-12-10T18:18:26.865 INFO:teuthology.orchestra.console:Power on smithi023
2021-12-10T18:18:30.901 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2021-12-10T18:18:31.003 INFO:teuthology.orchestra.console:Power on smithi190
2021-12-10T18:18:35.234 INFO:teuthology.orchestra.console:Power on for smithi023 completed
2021-12-10T18:18:35.258 INFO:teuthology.orchestra.console:Power on for smithi190 completed
2021-12-10T18:18:35.336 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2021-12-10T18:18:35.359 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2021-12-10T18:23:24.920 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-10T18:23:25.178 INFO:teuthology.provision.fog.smithi190:Node is ready
2021-12-10T18:23:25.194 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com
2021-12-10T18:23:25.250 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190
2021-12-10T18:23:25.582 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2021-12-10T18:23:55.149 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-10T18:23:55.446 INFO:teuthology.provision.fog.smithi023:Node is ready
2021-12-10T18:23:55.464 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2021-12-10T18:23:55.520 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2021-12-10T18:23:55.850 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2021-12-10T18:23:56.002 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2021-12-10T18:23:56.003 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-10T18:23:56.023 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com
2021-12-10T18:23:56.023 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-10T18:23:56.043 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2021-12-10T18:23:56.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2021-12-10T18:23:56.236 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2021-12-10T18:23:56.293 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream"
2021-12-10T18:23:56.294 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8"
2021-12-10T18:23:56.294 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos"
2021-12-10T18:23:56.294 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora"
2021-12-10T18:23:56.294 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8"
2021-12-10T18:23:56.295 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2021-12-10T18:23:56.295 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-10T18:23:56.295 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2021-12-10T18:23:56.295 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-10T18:23:56.295 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/"
2021-12-10T18:23:56.296 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-10T18:23:56.296 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-10T18:23:56.296 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-10T18:23:56.297 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2021-12-10T18:23:56.317 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server
2021-12-10T18:23:56.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2021-12-10T18:23:56.555 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64
2021-12-10T18:23:56.611 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2021-12-10T18:23:56.612 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8"
2021-12-10T18:23:56.612 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2021-12-10T18:23:56.612 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2021-12-10T18:23:56.612 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8"
2021-12-10T18:23:56.613 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8"
2021-12-10T18:23:56.613 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-10T18:23:56.613 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2021-12-10T18:23:56.613 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-10T18:23:56.614 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2021-12-10T18:23:56.614 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-10T18:23:56.614 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-10T18:23:56.614 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-10T18:23:56.615 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2021-12-10T18:23:56.709 INFO:teuthology.dispatcher.supervisor:Running job 6557295
2021-12-10T18:23:56.710 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi/6557295 --name yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi/6557295/orig.config.yaml
2021-12-10T18:23:56.713 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi/6557295
2021-12-10T18:23:56.713 INFO:teuthology.dispatcher.supervisor:Job PID: 27400
2021-12-10T18:23:56.714 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-11T06:24:17.553 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-11T06:24:17.834 INFO:teuthology.kill:Killing Pids: {27400}
2021-12-11T06:24:19.244 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-11T06:24:19.245 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-11T06:24:19.245 INFO:teuthology.misc:Compressing logs...
2021-12-11T06:24:19.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2021-12-11T06:24:19.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2021-12-11T06:24:19.488 INFO:teuthology.orchestra.run.smithi023.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-11T06:24:19.678 INFO:teuthology.orchestra.run.smithi190.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-11T06:24:19.723 INFO:teuthology.orchestra.run.smithi023.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-11T06:24:19.723 INFO:teuthology.orchestra.run.smithi023.stderr:tar: Error is not recoverable: exiting now
2021-12-11T06:24:19.834 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-11T06:24:19.834 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now
2021-12-11T06:24:19.836 INFO:teuthology.misc:Compressing logs...
2021-12-11T06:24:20.083 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-11T06:24:20.228 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-11T06:24:20.429 INFO:teuthology.misc:Compressing logs...
2021-12-11T06:24:21.583 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-mgr.smithi190.wojigj.log: file size changed while zipping
2021-12-11T06:24:25.739 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-mon.smithi023.log: file size changed while zipping
2021-12-11T06:24:26.851 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-11T06:24:30.975 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-11T06:24:31.417 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-11T06:24:35.914 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-11T06:24:36.628 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-11T06:24:39.574 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-11T06:24:40.931 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-11T06:24:43.563 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-mon.smithi190.log: file size changed while zipping
2021-12-11T06:24:45.001 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/e1d072ac-59e6-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-11T06:25:33.870 INFO:teuthology.kill:No teuthology processes running
2021-12-11T06:25:35.081 INFO:teuthology.kill:Nuking machines: ['smithi023', 'smithi190']
2021-12-11T06:25:36.102 INFO:teuthology.kill:2021-12-11 06:25:36,102.102 INFO:teuthology.nuke:targets:
2021-12-11T06:25:36.103 INFO:teuthology.kill:  smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQp/5zjYH4biGwbC1O8KoGOtTFsQ54ssvIO2NR56LA1oScd0lVRQ4p4Nt7/4ZH34XbcTs7G0cr+ogl0tf32F+RqFSrZrnDrnM1qCIn2aa7pYq4UXzlFMc6cKkPUS9jnh38KaWOK5lhzGX5HSBp0ZsVl0F0nqw1IUvPSlRREvm/cQXsXnvceg3cOgbwH0MYCi7+1ZDRrvO6AfqNQeJ7zIePdf6t0y0Yn6B6oFVaf/vhzsp+mOxiKe58F7qyNzUot2tKRoC2A/fCrFKjfcxJDRvrr911q/5ELREJ2wR/ZOez9SQ7J/EdVQngCAYIR40PfI4BO+GZpWCwC7JmeNy4T09K8xcidvEI6XaR90gu+5zaNAOYTScAQiyzveQaJxZIQrxBbsnIKNjUPZukTlglX8D7cBZpOfJ+r4FdbOsPquolYYAUGNwBaeHL01okHxvL1IYew05ziXkLL7aIA5ZaHhNRWr8VVghyhV9AhDr8+tly9bt4+Xe1A7oZO9FzHJ/nlMk=
2021-12-11T06:25:36.103 INFO:teuthology.kill:  smithi190.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRnnPAKwDXH9m8MPH6Ashw2sA3fIRNNW5kA5AA4JwCONQAS/KglmcG9rAqU9INSFtMVtN3NlDrWBgfW7BFs9ELInEFZv3QORK2WX9QrfdwwfOrDLlPoLYRFEnriPCH+OLQrwr3g1eEPPzRtEEYIRRtoxgfUZtd9uO6IE2vaqwznITlYkP8J+K/xCXXIfcYfO0BiTp+flACvd2ejsTNBCQHWnMESfVJISxMpQd8vQxsEyVL7sOoxICbUfpq5Lb1tcdFhTiLmqyBAiVQ24W20JpIySHlUkCUVu21IZfbQgFJEWlwJN2a21Ul04s9N1Ye3YyrcdSWbZkLPOBMrkl0ySyOgGUAtKzq8kGm5zcf/l6/T3a0xOb83RjEIEiGNivPC+B36R0O3d9k3PrC/+AQOk6kBuu2QztZKdacMFaG7q4lySuVKxwxXZGTKRAhuFzbb41Jf8Kk30l6Sah6Djk+f1OO/HW8LdbNebbCNq7CMofPFUQVvpK1YyVkWallNh/GHCM=
2021-12-11T06:25:36.130 INFO:teuthology.kill:2021-12-11 06:25:36,130.130 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-11T06:25:36.133 INFO:teuthology.kill:2021-12-11 06:25:36,133.133 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-11T06:25:36.215 INFO:teuthology.kill:2021-12-11 06:25:36,214.214 INFO:teuthology.orchestra.console:Power off smithi190
2021-12-11T06:25:36.229 INFO:teuthology.kill:2021-12-11 06:25:36,229.229 INFO:teuthology.orchestra.console:Power off smithi023
2021-12-11T06:25:48.703 INFO:teuthology.kill:2021-12-11 06:25:48,702.702 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2021-12-11T06:25:48.710 INFO:teuthology.kill:2021-12-11 06:25:48,710.710 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2021-12-11T06:25:48.853 INFO:teuthology.kill:2021-12-11 06:25:48,852.852 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com
2021-12-11T06:25:48.856 INFO:teuthology.kill:2021-12-11 06:25:48,855.855 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com
2021-12-11T06:27:49.190 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-11T06:27:49.294 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi023 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-10_03:20:03-krbd-master-testing-default-smithi/6555966
2021-12-11T06:27:49.295 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-10_03:20:03-krbd-master-testing-default-smithi/6555966