2022-01-22T06:53:11.948 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-22T06:53:12.078 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging
2022-01-22T06:53:12.079 INFO:teuthology.lock.ops:Updating [ubuntu@smithi164.front.sepia.ceph.com]: reset os type and version on server
2022-01-22T06:53:12.080 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2022-01-22T06:53:12.098 INFO:teuthology.lock.ops:Node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging is complete
2022-01-22T06:53:12.098 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging
2022-01-22T06:53:12.099 INFO:teuthology.lock.ops:Updating [ubuntu@smithi201.front.sepia.ceph.com]: reset os type and version on server
2022-01-22T06:53:12.099 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2022-01-22T06:53:12.117 INFO:teuthology.lock.ops:Node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging is complete
2022-01-22T06:53:12.315 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 8.stream
2022-01-22T06:53:12.369 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of centos 8.stream
2022-01-22T06:53:12.662 INFO:teuthology.orchestra.console:Power off smithi164
2022-01-22T06:53:12.730 INFO:teuthology.orchestra.console:Power off smithi201
2022-01-22T06:53:21.040 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2022-01-22T06:53:21.101 INFO:teuthology.orchestra.console:Power off for smithi201 completed
2022-01-22T06:53:21.142 INFO:teuthology.orchestra.console:Power on smithi164
2022-01-22T06:53:21.203 INFO:teuthology.orchestra.console:Power on smithi201
2022-01-22T06:53:29.545 INFO:teuthology.orchestra.console:Power on for smithi164 completed
2022-01-22T06:53:29.569 INFO:teuthology.orchestra.console:Power on for smithi201 completed
2022-01-22T06:53:29.648 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2022-01-22T06:53:29.670 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish
2022-01-22T06:57:27.118 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-22T06:57:52.536 INFO:teuthology.provision.fog.smithi201:Node is ready
2022-01-22T06:57:52.557 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com
2022-01-22T06:57:52.615 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201
2022-01-22T06:57:52.975 INFO:teuthology.provision.fog.smithi201:Deploy complete!
2022-01-22T06:58:25.796 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-22T06:58:26.075 INFO:teuthology.provision.fog.smithi164:Node is ready
2022-01-22T06:58:26.092 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2022-01-22T06:58:26.148 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2022-01-22T06:58:26.481 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2022-01-22T06:58:26.668 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2022-01-22T06:58:26.669 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-22T06:58:26.691 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com
2022-01-22T06:58:26.691 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-22T06:58:26.710 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2022-01-22T06:58:26.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2022-01-22T06:58:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2022-01-22T06:58:26.953 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2022-01-22T06:58:26.954 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8"
2022-01-22T06:58:26.954 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2022-01-22T06:58:26.955 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2022-01-22T06:58:26.955 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8"
2022-01-22T06:58:26.955 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2022-01-22T06:58:26.955 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-22T06:58:26.956 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2022-01-22T06:58:26.956 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-22T06:58:26.956 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2022-01-22T06:58:26.956 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-22T06:58:26.957 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-22T06:58:26.957 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-22T06:58:26.958 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2022-01-22T06:58:26.977 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server
2022-01-22T06:58:26.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com'
2022-01-22T06:58:27.225 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64
2022-01-22T06:58:27.282 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="CentOS Stream"
2022-01-22T06:58:27.283 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="8"
2022-01-22T06:58:27.283 INFO:teuthology.orchestra.run.smithi201.stdout:ID="centos"
2022-01-22T06:58:27.283 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE="rhel fedora"
2022-01-22T06:58:27.284 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="8"
2022-01-22T06:58:27.284 INFO:teuthology.orchestra.run.smithi201.stdout:PLATFORM_ID="platform:el8"
2022-01-22T06:58:27.284 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-22T06:58:27.284 INFO:teuthology.orchestra.run.smithi201.stdout:ANSI_COLOR="0;31"
2022-01-22T06:58:27.285 INFO:teuthology.orchestra.run.smithi201.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-22T06:58:27.285 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://centos.org/"
2022-01-22T06:58:27.285 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-22T06:58:27.285 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-22T06:58:27.285 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-22T06:58:27.286 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2022-01-22T06:58:27.384 INFO:teuthology.dispatcher.supervisor:Running job 6633056
2022-01-22T06:58:27.385 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-21_19:17:29-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi/6633056 --name yuriw-2022-01-21_19:17:29-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-01-21_19:17:29-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi/6633056/orig.config.yaml
2022-01-22T06:58:27.388 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-21_19:17:29-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi/6633056
2022-01-22T06:58:27.389 INFO:teuthology.dispatcher.supervisor:Job PID: 15677
2022-01-22T06:58:27.389 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-22T13:28:57.220 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-22T13:28:57.436 INFO:teuthology.kill:Killing Pids: {15677}
2022-01-22T13:28:58.668 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-22T13:28:58.669 INFO:teuthology.task.internal:roles: ubuntu@smithi201.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-22T13:28:58.669 INFO:teuthology.misc:Compressing logs...
2022-01-22T13:28:58.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2022-01-22T13:28:58.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com'
2022-01-22T13:28:58.896 INFO:teuthology.orchestra.run.smithi164.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-22T13:28:59.109 INFO:teuthology.orchestra.run.smithi201.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-22T13:28:59.200 INFO:teuthology.orchestra.run.smithi164.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-22T13:28:59.201 INFO:teuthology.orchestra.run.smithi164.stderr:tar: Error is not recoverable: exiting now
2022-01-22T13:28:59.353 INFO:teuthology.orchestra.run.smithi201.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-22T13:28:59.353 INFO:teuthology.orchestra.run.smithi201.stderr:tar: Error is not recoverable: exiting now
2022-01-22T13:28:59.355 INFO:teuthology.misc:Compressing logs...
2022-01-22T13:28:59.601 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-22T13:28:59.755 INFO:teuthology.misc:Compressing logs...
2022-01-22T13:29:04.687 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-mgr.smithi164.tjmqcw.log: file size changed while zipping
2022-01-22T13:29:20.431 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-22T13:29:23.657 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-22T13:29:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-mon.smithi164.log: file size changed while zipping
2022-01-22T13:29:37.216 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-22T13:29:40.651 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-mon.smithi201.log: file size changed while zipping
2022-01-22T13:29:50.955 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-22T13:29:56.861 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-22T13:30:01.582 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-22T13:30:11.271 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-22T13:30:18.950 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/dafa4d5e-7b51-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-22T13:30:50.515 INFO:teuthology.orchestra.run.smithi201.stderr:tar: .: file changed as we read it
2022-01-22T13:30:50.576 INFO:teuthology.kill:No teuthology processes running
2022-01-22T13:30:51.731 INFO:teuthology.kill:Nuking machines: ['smithi164', 'smithi201']
2022-01-22T13:30:52.722 INFO:teuthology.kill:2022-01-22 13:30:52,722.722 INFO:teuthology.nuke:targets:
2022-01-22T13:30:52.723 INFO:teuthology.kill:  smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd7UFJhj8CBgU7W0nXUuM4keoAxAdwnWYbNGbzLJzPDJrYRrfS36VavJAH+tXLoNRd/OkZc5O42xsnlgV0utaS6A/pol4GMPBez7Tt+EXMTk2BQZPjMEZV41C/0StFpYwjb+dxeecZzE57QoRgKkmDJJONRKWeq412NZ7l85l784JPi0pBcMUxAgI6DBPRK70FOZ2RgRhPeUtV6TTcNepcRqn1ijsdyNVpr282XoSyGjx5pLJ8wrsGACrxGx6dZjymqW+tirVSuHCg2OBceYL0wezYnxIzBo3E5fGijuZTyKuyAMo+QCe/USvF7hHyYQaDsDVwJIrR15CJw5D85aWnkIf213q+mD4FziAWek//UufQ9gxN4qcwAkkpfd5Zwrb41D3ZHazLXXilsv17B/4CEgVNZ+ZHWxZ+PudkhdIp6rDlcGJ3IhmQzdKsYxQXp3Ai2F+Oej0Hs0J+FvV+DGvCX99Vz+LUKN4j6oypo+vQDzsK7d+fACH81HSFq596rrk=
2022-01-22T13:30:52.723 INFO:teuthology.kill:  smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDhxEFQAwZXttFlHxtgGKkLxmugfkzlWfjKGsryWkkx5HQMq5QdDi93IygRjUUKBnA5H4mPFWEvxCgbm37a7WDk1otUJI60ZzaeTtHtGVTQ2dWgl6dGc/I0/PMpEVg2owgzV+fw4hJfyNov5sAEVl1gs/tnPHTgoQSqNXePnsQBF8IMUGrgt8sAB7xniH7K1DPAc64qr9W5Jr/a/AUFSygRg8WZ67OHPab1ySXOuuReknREl/ZqLu4KiIBcTx4ClwJ/MWagwRJM9r0MFPR0ZpZ59Xbz1arlKjqTqQ4dQYhMuI7SzLUWE2Iajf7jQ3M6LPQDzLJuTMtZP90HNncL7D+GV7XcuHvZ9Zw92K6zMfHpUHdf6qOXJxqcFSYFVAXmNzY59K93zXs3jUQ+txb+EKJsrvU0j0hZTlLPfX8q/3nBrgzc8VHcXFiGHFe0aOZCcjicuU4nw+IqlRkY6OZRjj0pS8Rm7bru4nW1qKDPdS0ZVY3MHryG2FkzkVLQINzfks=
2022-01-22T13:30:52.749 INFO:teuthology.kill:2022-01-22 13:30:52,749.749 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-22T13:30:52.753 INFO:teuthology.kill:2022-01-22 13:30:52,753.753 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-22T13:30:52.829 INFO:teuthology.kill:2022-01-22 13:30:52,829.829 INFO:teuthology.orchestra.console:Power off smithi201
2022-01-22T13:30:52.844 INFO:teuthology.kill:2022-01-22 13:30:52,843.843 INFO:teuthology.orchestra.console:Power off smithi164
2022-01-22T13:31:01.201 INFO:teuthology.kill:2022-01-22 13:31:01,200.200 INFO:teuthology.orchestra.console:Power off for smithi201 completed
2022-01-22T13:31:01.349 INFO:teuthology.kill:2022-01-22 13:31:01,348.348 INFO:teuthology.lock.ops:unlocked: smithi201.front.sepia.ceph.com
2022-01-22T13:31:05.317 INFO:teuthology.kill:2022-01-22 13:31:05,316.316 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2022-01-22T13:31:05.463 INFO:teuthology.kill:2022-01-22 13:31:05,463.463 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com
2022-01-22T13:33:05.773 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-22T13:33:05.876 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-01-22_13:19:13-rados:thrash-wip-ronenf-scrub-be2-distro-basic-smithi/6634169
2022-01-22T13:33:05.877 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi201 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-01-22_13:19:13-rados:thrash-wip-ronenf-scrub-be2-distro-basic-smithi/6634169