2021-10-29T23:09:32.827 INFO:root:teuthology version: 1.1.0-c56135d1
2021-10-29T23:09:32.947 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging
2021-10-29T23:09:32.948 INFO:teuthology.lock.ops:Updating [ubuntu@smithi027.front.sepia.ceph.com]: reset os type and version on server
2021-10-29T23:09:32.948 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2021-10-29T23:09:32.968 INFO:teuthology.lock.ops:Node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging is complete
2021-10-29T23:09:32.968 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi102.front.sepia.ceph.com' reimaging
2021-10-29T23:09:32.968 INFO:teuthology.lock.ops:Updating [ubuntu@smithi102.front.sepia.ceph.com]: reset os type and version on server
2021-10-29T23:09:32.969 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2021-10-29T23:09:32.988 INFO:teuthology.lock.ops:Node 'ubuntu@smithi102.front.sepia.ceph.com' reimaging is complete
2021-10-29T23:09:33.206 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.2
2021-10-29T23:09:33.212 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.2
2021-10-29T23:09:33.573 INFO:teuthology.orchestra.console:Power off smithi027
2021-10-29T23:09:33.587 INFO:teuthology.orchestra.console:Power off smithi102
2021-10-29T23:09:41.939 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2021-10-29T23:09:41.943 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2021-10-29T23:09:42.041 INFO:teuthology.orchestra.console:Power on smithi027
2021-10-29T23:09:42.048 INFO:teuthology.orchestra.console:Power on smithi102
2021-10-29T23:09:50.409 INFO:teuthology.orchestra.console:Power on for smithi027 completed
2021-10-29T23:09:50.414 INFO:teuthology.orchestra.console:Power on for smithi102 completed
2021-10-29T23:09:50.511 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2021-10-29T23:09:50.515 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2021-10-29T23:14:25.096 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-29T23:14:25.419 INFO:teuthology.provision.fog.smithi027:Node is ready
2021-10-29T23:14:25.435 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2021-10-29T23:14:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2021-10-29T23:14:25.824 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2021-10-29T23:14:40.264 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-29T23:14:40.556 INFO:teuthology.provision.fog.smithi102:Node is ready
2021-10-29T23:14:40.572 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2021-10-29T23:14:40.628 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2021-10-29T23:14:40.959 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2021-10-29T23:14:41.124 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2021-10-29T23:14:41.124 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-29T23:14:41.144 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2021-10-29T23:14:41.145 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-29T23:14:41.163 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2021-10-29T23:14:41.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2021-10-29T23:14:41.437 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2021-10-29T23:14:41.492 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Linux"
2021-10-29T23:14:41.492 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8 (Core)"
2021-10-29T23:14:41.492 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2021-10-29T23:14:41.492 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2021-10-29T23:14:41.493 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2021-10-29T23:14:41.493 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2021-10-29T23:14:41.493 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-10-29T23:14:41.493 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2021-10-29T23:14:41.494 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-29T23:14:41.494 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.centos.org/"
2021-10-29T23:14:41.494 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-29T23:14:41.494 INFO:teuthology.orchestra.run.smithi027.stdout:
2021-10-29T23:14:41.494 INFO:teuthology.orchestra.run.smithi027.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-29T23:14:41.495 INFO:teuthology.orchestra.run.smithi027.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-29T23:14:41.495 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-10-29T23:14:41.495 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-10-29T23:14:41.495 INFO:teuthology.orchestra.run.smithi027.stdout:
2021-10-29T23:14:41.497 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2021-10-29T23:14:41.514 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2021-10-29T23:14:41.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2021-10-29T23:14:41.724 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2021-10-29T23:14:41.779 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Linux"
2021-10-29T23:14:41.780 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8 (Core)"
2021-10-29T23:14:41.780 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2021-10-29T23:14:41.780 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2021-10-29T23:14:41.780 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8"
2021-10-29T23:14:41.781 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2021-10-29T23:14:41.781 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-10-29T23:14:41.781 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2021-10-29T23:14:41.781 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-29T23:14:41.782 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.centos.org/"
2021-10-29T23:14:41.782 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-29T23:14:41.782 INFO:teuthology.orchestra.run.smithi102.stdout:
2021-10-29T23:14:41.782 INFO:teuthology.orchestra.run.smithi102.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-29T23:14:41.782 INFO:teuthology.orchestra.run.smithi102.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-29T23:14:41.783 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-10-29T23:14:41.783 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-10-29T23:14:41.783 INFO:teuthology.orchestra.run.smithi102.stdout:
2021-10-29T23:14:41.784 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2021-10-29T23:14:41.885 INFO:teuthology.dispatcher.supervisor:Running job 6467546
2021-10-29T23:14:41.885 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-10-29_17:42:41-rados-wip-yuri7-testing-2021-10-28-1307-distro-basic-smithi/6467546 --name yuriw-2021-10-29_17:42:41-rados-wip-yuri7-testing-2021-10-28-1307-distro-basic-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2021-10-29_17:42:41-rados-wip-yuri7-testing-2021-10-28-1307-distro-basic-smithi/6467546/orig.config.yaml
2021-10-29T23:14:41.889 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-10-29_17:42:41-rados-wip-yuri7-testing-2021-10-28-1307-distro-basic-smithi/6467546
2021-10-29T23:14:41.890 INFO:teuthology.dispatcher.supervisor:Job PID: 2296
2021-10-29T23:14:41.891 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-10-30T11:15:36.765 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-10-30T11:15:36.994 INFO:teuthology.kill:Killing Pids: {2296}
2021-10-30T11:15:38.164 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-10-30T11:15:38.165 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-10-30T11:15:38.165 INFO:teuthology.misc:Compressing logs...
2021-10-30T11:15:38.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2021-10-30T11:15:38.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2021-10-30T11:15:38.407 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-10-30T11:15:38.665 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-10-30T11:15:38.712 INFO:teuthology.orchestra.run.smithi027.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-10-30T11:15:38.712 INFO:teuthology.orchestra.run.smithi027.stderr:tar: Error is not recoverable: exiting now
2021-10-30T11:15:38.756 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-10-30T11:15:38.756 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now
2021-10-30T11:15:38.758 INFO:teuthology.misc:Compressing logs...
2021-10-30T11:15:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-30T11:15:39.380 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-30T11:15:39.731 INFO:teuthology.misc:Compressing logs...
2021-10-30T11:15:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-mgr.smithi027.wzaqxt.log: file size changed while zipping
2021-10-30T11:16:07.785 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-10-30T11:16:14.665 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-mon.smithi102.log: file size changed while zipping
2021-10-30T11:16:34.332 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-mon.smithi027.log: file size changed while zipping
2021-10-30T11:16:42.140 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-10-30T11:16:55.394 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-10-30T11:17:05.579 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-10-30T11:17:26.042 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-10-30T11:17:37.194 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-10-30T11:17:56.762 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/5028ca22-390f-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-10-30T11:18:50.701 INFO:teuthology.kill:No teuthology processes running
2021-10-30T11:18:51.811 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi102']
2021-10-30T11:18:52.763 INFO:teuthology.kill:2021-10-30 11:18:52,762.762 INFO:teuthology.nuke:targets:
2021-10-30T11:18:52.764 INFO:teuthology.kill:  smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ek/AbZt87AcT21Bt/3VicT2HvlB2qFifiaB3VJ+WNXptXj+1WzP/QkGFgAUsXuQQtmRb0K4NzMtz/4UPFOdNE37qYcljoqp9lzYtcsZmttIdYa3TcRv8qGaSZMO7YkKF/bPYfp6WGXj+bYke7eZB9quHTRcn1dLm/2dx3GCmoDdOJX2sUVsEDNqZ9OeLTsshRRm4psTqoJDdRNUr0bOj3dSSgkuxVomRclh1NzLBRkGBDGHcHNjJMnHWo45fdSYF0bUd9WQfBXxm3PPfbdMnsx7uK1zusDYE29i2WzGVIa8ChqlGr7WrDAv+uLQOD2VcMjNNhJ01OxUDS+LaDnY3DI2DYYIG99dHIYQcX77DzvkVsnvgij9ejCCsxskbUN1Ugznz/UNyRYAa3zeeh78VX8FaeZD7wpz2q2TmNX+aIYnE1VndKKL6pIOqnhQMPWU77rKend2/0M4dqM3sabsm8zieX0YZaFrPeeYdurMUWEfInwzosEj2pAU58m9/xCk=
2021-10-30T11:18:52.765 INFO:teuthology.kill:  smithi102.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9Gl9Yfkptv/IZ1ZuimMUMAZHWylKFhL6fhtxWVh5XQqDTtbsif/Y+LXuS9jBxzXLV3jWMWUGqJZysTlaZgbu+qkvq0eVb8T/OD0raheVwEd3iVLZMicgwM8fMYSoHCP4RPUuWJmtRqHNWxKkCZkb/0eI9j//WvzUZ0x5Ehx7QOyqE5hqm7kXQl11A6FWszJIdGfcOXmPRlP3rftriGGbnh7DaI79WsWKni4+cmRqNssTiSjGue0W6iRjA+DuDeJYvQwy9qkJRzhtPinM8BhCpXVGPncM2krBP/nXBKCvTaeYoFmMZOb6JT8AMh+EE6S3umSk1LFsH37jbmnYHT9+Lx2RQ6q84mUnzhn66PG55/GRVSKCnOXDhT1oZsfov1kIDvivPQkhZM8O6UCI1NIaqu6MbuDR9NrEsTLUO0g9WFmrPfxIEnUbq4ZCMVHjh5yv3NDMaQihWJJeM37cg8GNFb9htj99Y42Iol//kxJ4I461niGCkk8zrzSj/E0KyNS0=
2021-10-30T11:18:52.789 INFO:teuthology.kill:2021-10-30 11:18:52,789.789 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-30T11:18:52.830 INFO:teuthology.kill:2021-10-30 11:18:52,830.830 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-30T11:18:52.859 INFO:teuthology.kill:2021-10-30 11:18:52,859.859 INFO:teuthology.orchestra.console:Power off smithi027
2021-10-30T11:18:52.919 INFO:teuthology.kill:2021-10-30 11:18:52,919.919 INFO:teuthology.orchestra.console:Power off smithi102
2021-10-30T11:19:05.346 INFO:teuthology.kill:2021-10-30 11:19:05,346.346 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2021-10-30T11:19:05.392 INFO:teuthology.kill:2021-10-30 11:19:05,392.392 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2021-10-30T11:19:05.493 INFO:teuthology.kill:2021-10-30 11:19:05,492.492 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2021-10-30T11:19:05.535 INFO:teuthology.kill:2021-10-30 11:19:05,535.535 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com
2021-10-30T11:21:05.849 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-10-30T11:21:05.948 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-10-29_05:17:03-krbd-pacific-testing-default-smithi/6466765
2021-10-30T11:21:05.948 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi102 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-10-29_05:17:03-krbd-pacific-testing-default-smithi/6466765