2021-12-01T04:12:39.212 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-01T04:12:39.363 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi019.front.sepia.ceph.com' reimaging
2021-12-01T04:12:39.364 INFO:teuthology.lock.ops:Updating [ubuntu@smithi019.front.sepia.ceph.com]: reset os type and version on server
2021-12-01T04:12:39.364 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2021-12-01T04:12:39.384 INFO:teuthology.lock.ops:Node 'ubuntu@smithi019.front.sepia.ceph.com' reimaging is complete
2021-12-01T04:12:39.384 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging
2021-12-01T04:12:39.385 INFO:teuthology.lock.ops:Updating [ubuntu@smithi190.front.sepia.ceph.com]: reset os type and version on server
2021-12-01T04:12:39.385 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2021-12-01T04:12:39.407 INFO:teuthology.lock.ops:Node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging is complete
2021-12-01T04:12:39.595 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 8.stream
2021-12-01T04:12:39.635 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.stream
2021-12-01T04:12:39.896 INFO:teuthology.orchestra.console:Power off smithi019
2021-12-01T04:12:39.944 INFO:teuthology.orchestra.console:Power off smithi190
2021-12-01T04:12:48.281 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2021-12-01T04:12:48.383 INFO:teuthology.orchestra.console:Power on smithi019
2021-12-01T04:12:52.436 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2021-12-01T04:12:52.537 INFO:teuthology.orchestra.console:Power on smithi190
2021-12-01T04:12:56.757 INFO:teuthology.orchestra.console:Power on for smithi019 completed
2021-12-01T04:12:56.858 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2021-12-01T04:13:00.905 INFO:teuthology.orchestra.console:Power on for smithi190 completed
2021-12-01T04:13:01.006 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2021-12-01T04:17:31.489 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-01T04:17:31.786 INFO:teuthology.provision.fog.smithi019:Node is ready
2021-12-01T04:17:31.803 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2021-12-01T04:17:31.860 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2021-12-01T04:17:32.196 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2021-12-01T04:17:50.641 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-01T04:17:50.924 INFO:teuthology.provision.fog.smithi190:Node is ready
2021-12-01T04:17:50.941 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com
2021-12-01T04:17:50.998 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190
2021-12-01T04:17:51.342 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2021-12-01T04:17:51.523 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2021-12-01T04:17:51.525 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-01T04:17:51.548 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com
2021-12-01T04:17:51.549 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-01T04:17:51.571 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2021-12-01T04:17:51.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2021-12-01T04:17:51.821 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2021-12-01T04:17:51.879 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2021-12-01T04:17:51.879 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8"
2021-12-01T04:17:51.880 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2021-12-01T04:17:51.880 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2021-12-01T04:17:51.880 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8"
2021-12-01T04:17:51.881 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8"
2021-12-01T04:17:51.881 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-01T04:17:51.881 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2021-12-01T04:17:51.881 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-01T04:17:51.882 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2021-12-01T04:17:51.882 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-01T04:17:51.882 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-01T04:17:51.882 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-01T04:17:51.884 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2021-12-01T04:17:51.902 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server
2021-12-01T04:17:51.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2021-12-01T04:17:52.087 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64
2021-12-01T04:17:52.142 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2021-12-01T04:17:52.143 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8"
2021-12-01T04:17:52.143 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2021-12-01T04:17:52.143 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2021-12-01T04:17:52.143 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8"
2021-12-01T04:17:52.144 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8"
2021-12-01T04:17:52.144 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-01T04:17:52.144 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2021-12-01T04:17:52.144 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-01T04:17:52.144 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2021-12-01T04:17:52.145 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-01T04:17:52.145 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-01T04:17:52.145 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-01T04:17:52.146 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2021-12-01T04:17:52.245 INFO:teuthology.dispatcher.supervisor:Running job 6537200
2021-12-01T04:17:52.245 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-01_02:24:37-rados-wip-yuri5-testing-2021-11-30-1628-distro-default-smithi/6537200 --name yuriw-2021-12-01_02:24:37-rados-wip-yuri5-testing-2021-11-30-1628-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2021-12-01_02:24:37-rados-wip-yuri5-testing-2021-11-30-1628-distro-default-smithi/6537200/orig.config.yaml
2021-12-01T04:17:52.248 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-01_02:24:37-rados-wip-yuri5-testing-2021-11-30-1628-distro-default-smithi/6537200
2021-12-01T04:17:52.249 INFO:teuthology.dispatcher.supervisor:Job PID: 14750
2021-12-01T04:17:52.249 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-01T16:18:48.529 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-01T16:18:48.758 INFO:teuthology.kill:Killing Pids: {14750}
2021-12-01T16:18:50.076 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-01T16:18:50.077 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-01T16:18:50.077 INFO:teuthology.misc:Compressing logs...
2021-12-01T16:18:50.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2021-12-01T16:18:50.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2021-12-01T16:18:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-01T16:18:50.511 INFO:teuthology.orchestra.run.smithi190.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-01T16:18:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-01T16:18:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:tar: Error is not recoverable: exiting now
2021-12-01T16:18:50.588 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-01T16:18:50.589 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now
2021-12-01T16:18:50.590 INFO:teuthology.misc:Compressing logs...
2021-12-01T16:18:51.197 INFO:teuthology.misc:Compressing logs...
2021-12-01T16:19:14.249 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-01T16:19:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-01T16:19:24.881 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-mon.smithi190.log: file size changed while zipping
2021-12-01T16:19:32.880 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-mgr.smithi190.shikic.log: file size changed while zipping
2021-12-01T16:19:44.280 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-01T16:19:58.869 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-01T16:20:05.233 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-mon.smithi019.log: file size changed while zipping
2021-12-01T16:20:23.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-01T16:20:25.386 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-01T16:20:50.730 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-01T16:20:56.549 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/0a842b24-525f-11ec-8c2d-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-01T16:21:45.189 INFO:teuthology.kill:No teuthology processes running
2021-12-01T16:21:46.366 INFO:teuthology.kill:Nuking machines: ['smithi019', 'smithi190']
2021-12-01T16:21:47.337 INFO:teuthology.kill:2021-12-01 16:21:47,337.337 INFO:teuthology.nuke:targets:
2021-12-01T16:21:47.338 INFO:teuthology.kill:  smithi019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ8jz8Cq2Z8lBvBJKB7NRiNLyYNQaR7VRkaZkp4D7e29IbIbFog5ONwnvvnRmDFOpvLV5+UTeE5w3C2NuvusHjeKPYbrn8b6Mk6DlQQxUVAWpfbZM5we/wWLSV0t1qIJxIJG6z30n/RnpDxoWGuRJ+HwFB5KXP3vSq6yLjPo7C8xh5DjGTxPxdDHJUYnBp54dgkp7nJrk2eLRDaH92BgutHx1NTrvdV5BzgtWksoN293ELqb+35lsZtmOyq7hiXDEHUQn4SaGv6bIYQP+EtFAI0oY05Curv5qCkq/ucAOGpapg0nubHQBb5mta/WW5Q8oVmwMAV1OJoWuOYLGgBfLk7MqyD2Ce/dhvKKfwRBdPHX2AFIC0QPowKlZpjketyVAKV4UqVFp2IHshRI5iz7hANAYVdRAkvB9tLARgoQEoMbiWS7lWVw34gfemyzDLDPkIBD8a5MeaaZWC8efpwH07NpObfbr+2inlVsYpAwmJBUNAy9L4C+Fr4HJZclF8yI0=
2021-12-01T16:21:47.338 INFO:teuthology.kill:  smithi190.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDde5kAs0RIdUoiIgso/SMYME38xMs9VPA2VI4h9mGyyIAboE1vO8vyiAGiNeCISLHpHwe6fvjaVhJGz/CsahXqFIipiS62WsxpFK7uQkJp8vwUFET0XKcSLGo0S0X0jkkqo4XZohkwjBfefS4CGkjX8ShsfcJ2ORpTdiq6NcapEPZ7pi3UOoPqt7jrAo+OEm/dHNAmod0Q72GHKp8CEagdvQpUwRhHjIooJQddqYvWhLDQhSeK9Pmg5ZsF6OQYFKQe5CjZAKL5U60kGYx2Mg7TYnR2xRYPXTN698sVN1joDgm5v+Q7B+LOF+qlaLVdyqcc2qs+oenYaBTz5auV0uZbE/50JC73F3Q1UXzbK5N3cX/jphYsDULk+2UYDhRSe0Xg+hjnFo+GlkysX2ecepYEPStHHQY9o7zZ27v6wuLzo5vRWwLXix8R5Wn3mH1jpKef18/sfAr0HLtcvIPQAB0NPg7sagCmHCU2VVERL1ou0BSM340W2S/9GwpNyA1J9ds=
2021-12-01T16:21:47.363 INFO:teuthology.kill:2021-12-01 16:21:47,363.363 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-01T16:21:47.368 INFO:teuthology.kill:2021-12-01 16:21:47,368.368 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-01T16:21:47.434 INFO:teuthology.kill:2021-12-01 16:21:47,434.434 INFO:teuthology.orchestra.console:Power off smithi190
2021-12-01T16:21:47.456 INFO:teuthology.kill:2021-12-01 16:21:47,455.455 INFO:teuthology.orchestra.console:Power off smithi019
2021-12-01T16:21:59.921 INFO:teuthology.kill:2021-12-01 16:21:59,921.921 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2021-12-01T16:21:59.925 INFO:teuthology.kill:2021-12-01 16:21:59,925.925 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2021-12-01T16:22:00.073 INFO:teuthology.kill:2021-12-01 16:22:00,072.072 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com
2021-12-01T16:22:00.076 INFO:teuthology.kill:2021-12-01 16:22:00,075.075 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com
2021-12-01T16:24:00.397 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-01T16:24:00.501 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/ifed01-2021-12-01_14:08:22-rados-wip-ifed-daemonhistogram-distro-default-smithi/6538394