2022-01-24T12:40:33.973 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-24T12:40:34.098 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging
2022-01-24T12:40:34.099 INFO:teuthology.lock.ops:Updating [ubuntu@smithi110.front.sepia.ceph.com]: reset os type and version on server
2022-01-24T12:40:34.100 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2022-01-24T12:40:34.121 INFO:teuthology.lock.ops:Node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging is complete
2022-01-24T12:40:34.121 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging
2022-01-24T12:40:34.121 INFO:teuthology.lock.ops:Updating [ubuntu@smithi115.front.sepia.ceph.com]: reset os type and version on server
2022-01-24T12:40:34.122 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2022-01-24T12:40:34.145 INFO:teuthology.lock.ops:Node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging is complete
2022-01-24T12:40:34.344 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 8.2
2022-01-24T12:40:34.390 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.2
2022-01-24T12:40:34.795 INFO:teuthology.orchestra.console:Power off smithi110
2022-01-24T12:40:34.858 INFO:teuthology.orchestra.console:Power off smithi115
2022-01-24T12:40:34.946 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2022-01-24T12:40:35.001 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2022-01-24T12:40:35.048 INFO:teuthology.orchestra.console:Power on smithi110
2022-01-24T12:40:35.102 INFO:teuthology.orchestra.console:Power on smithi115
2022-01-24T12:40:39.312 INFO:teuthology.orchestra.console:Power on for smithi110 completed
2022-01-24T12:40:39.415 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2022-01-24T12:40:43.473 INFO:teuthology.orchestra.console:Power on for smithi115 completed
2022-01-24T12:40:43.574 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2022-01-24T12:43:14.995 ERROR:teuthology.orchestra.connection:Error authenticating with smithi115.front.sepia.ceph.com: Authentication failed.
2022-01-24T12:45:11.504 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-24T12:45:11.794 INFO:teuthology.provision.fog.smithi110:Node is ready
2022-01-24T12:45:11.848 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2022-01-24T12:45:11.904 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2022-01-24T12:45:12.222 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2022-01-24T12:45:28.257 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-24T12:45:28.555 INFO:teuthology.provision.fog.smithi115:Node is ready
2022-01-24T12:45:28.611 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2022-01-24T12:45:28.667 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2022-01-24T12:45:29.002 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2022-01-24T12:45:29.144 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2022-01-24T12:45:29.145 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-24T12:45:29.163 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2022-01-24T12:45:29.164 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-24T12:45:29.181 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2022-01-24T12:45:29.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2022-01-24T12:45:29.396 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2022-01-24T12:45:29.452 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Linux"
2022-01-24T12:45:29.452 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8 (Core)"
2022-01-24T12:45:29.452 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2022-01-24T12:45:29.453 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2022-01-24T12:45:29.453 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8"
2022-01-24T12:45:29.453 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8"
2022-01-24T12:45:29.453 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2022-01-24T12:45:29.454 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2022-01-24T12:45:29.454 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-24T12:45:29.454 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.centos.org/"
2022-01-24T12:45:29.454 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-24T12:45:29.455 INFO:teuthology.orchestra.run.smithi110.stdout:
2022-01-24T12:45:29.455 INFO:teuthology.orchestra.run.smithi110.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-24T12:45:29.455 INFO:teuthology.orchestra.run.smithi110.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-24T12:45:29.455 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2022-01-24T12:45:29.456 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2022-01-24T12:45:29.456 INFO:teuthology.orchestra.run.smithi110.stdout:
2022-01-24T12:45:29.457 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2022-01-24T12:45:29.474 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2022-01-24T12:45:29.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2022-01-24T12:45:29.730 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2022-01-24T12:45:29.784 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Linux"
2022-01-24T12:45:29.785 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8 (Core)"
2022-01-24T12:45:29.785 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2022-01-24T12:45:29.785 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2022-01-24T12:45:29.785 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2022-01-24T12:45:29.786 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2022-01-24T12:45:29.786 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2022-01-24T12:45:29.786 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2022-01-24T12:45:29.786 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-24T12:45:29.787 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.centos.org/"
2022-01-24T12:45:29.787 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-24T12:45:29.787 INFO:teuthology.orchestra.run.smithi115.stdout:
2022-01-24T12:45:29.787 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-24T12:45:29.788 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-24T12:45:29.788 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2022-01-24T12:45:29.788 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2022-01-24T12:45:29.789 INFO:teuthology.orchestra.run.smithi115.stdout:
2022-01-24T12:45:29.789 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2022-01-24T12:45:29.890 INFO:teuthology.dispatcher.supervisor:Running job 6636733
2022-01-24T12:45:29.891 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6636733 --name teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6636733/orig.config.yaml
2022-01-24T12:45:29.894 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6636733
2022-01-24T12:45:29.895 INFO:teuthology.dispatcher.supervisor:Job PID: 28070
2022-01-24T12:45:29.895 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-24T19:15:40.541 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-24T19:15:40.749 INFO:teuthology.kill:Killing Pids: {28070}
2022-01-24T19:15:41.835 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-24T19:15:41.836 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-24T19:15:41.836 INFO:teuthology.misc:Compressing logs...
2022-01-24T19:15:41.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2022-01-24T19:15:42.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2022-01-24T19:15:42.088 INFO:teuthology.orchestra.run.smithi110.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-24T19:15:42.295 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-24T19:15:42.380 INFO:teuthology.orchestra.run.smithi110.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-24T19:15:42.381 INFO:teuthology.orchestra.run.smithi110.stderr:tar: Error is not recoverable: exiting now
2022-01-24T19:15:42.415 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-24T19:15:42.416 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now
2022-01-24T19:15:42.417 INFO:teuthology.misc:Compressing logs...
2022-01-24T19:15:42.611 INFO:teuthology.misc:Compressing logs...
2022-01-24T19:15:50.595 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-24T19:15:51.673 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-24T19:15:52.501 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-mgr.smithi110.qmdmvg.log: file size changed while zipping
2022-01-24T19:15:58.635 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-24T19:16:00.358 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-24T19:16:06.107 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-24T19:16:09.546 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-mon.smithi115.log: file size changed while zipping
2022-01-24T19:16:10.219 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-mon.smithi110.log: file size changed while zipping
2022-01-24T19:16:18.398 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-24T19:16:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-24T19:16:29.495 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/bf390122-7d14-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-24T19:16:46.429 INFO:teuthology.kill:No teuthology processes running
2022-01-24T19:16:47.474 INFO:teuthology.kill:Nuking machines: ['smithi110', 'smithi115']
2022-01-24T19:16:48.377 INFO:teuthology.kill:2022-01-24 19:16:48,376.376 INFO:teuthology.nuke:targets:
2022-01-24T19:16:48.377 INFO:teuthology.kill:  smithi110.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuB77Q1HpLbMBh57iU+YTPlBoQGyN/XudBQkMdwO524BxtuzGnuXdEyo/KOlZp/RYCMZhCeqtN5XR3IYcVbiVZN/GZEtL4XKe9Qihqwr6TS/B4ZqJrOzPyRflQ9qGshHvDc4hEFltuASeBXtv1C2WOpL4DfFDLAPbpbvBnghlnwHTpe3kKOk7AWFOEya1HwAnmBnf/XPMi120WZnZPIzDt7l2QbGfCPPh6Aw/DoCGOy/f7PhnM/g4ZTSbi6dMkmtXJE3SNUi290uwlK28WVEnOpaFxuv7YAF5O+wQB0KIQTW+aF0CIUp5g6S3C2QoLusUBtytUALfECNG2Gs2rVRJIT0HSoXlwK1IybrOOou0vhJNVhRz0zFL4x9K5cmYq53/wU1gGm6RGTiNISwh7pn+RgJv+/JtZuLIvXX3a2117+I0DUj2W1WFNwX/gxj9WgEqma4sOIChct1jmo08eZSnE/84Gpyz0pzKjEXD4bueyMgmi0Z2bbh/9rcINANvljRE=
2022-01-24T19:16:48.378 INFO:teuthology.kill:  smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD1h/nYfRJigeKWV8FXuKWnqBkqUbS19utWYcCkDdxEd8VLQMwZne/ghOTOwJm95A5aWYSLFp7BSVyHN3Da0jORVNbunx+xlHhUmTR8z9WGVSPGDMlEjc5FeSzDzS9NKMMmJ2jTrG55C3miNskLyKvoaNZsR6B8jiQjx7GAZuHKfF50kOceLFdIWyr63rQ39VwzmqDadoxlanEiV0H+ZkjjAQDR/SwgfRRh95nhLnBRs6G1sS7eXCCOo4YT4tSXCY4G/SN3WlGmbI9RoG5BbR46cSNkBwmMikF8l36a+E94dIM6304QoqVPnSzqOnvmh2NbxZwBaixlsoziku02OeKTgL07MZC27D0cw7n0B9XjOOwnMzvd9Q3G6x1xSk4sR6AAVNmYLWFlF5ZOhe8AU5oFiz5eSYenQsCm2AtrBC9p4INpwoLfiK6W4B30QAt5HyceoUwbQp7EBPVIcntLiflfAPQKAkURLpvKykbz8VDJJWh+OEsEqsqhGv7k181HTDk=
2022-01-24T19:16:48.403 INFO:teuthology.kill:2022-01-24 19:16:48,403.403 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-24T19:16:48.406 INFO:teuthology.kill:2022-01-24 19:16:48,406.406 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-24T19:16:48.477 INFO:teuthology.kill:2022-01-24 19:16:48,477.477 INFO:teuthology.orchestra.console:Power off smithi110
2022-01-24T19:16:48.490 INFO:teuthology.kill:2022-01-24 19:16:48,489.489 INFO:teuthology.orchestra.console:Power off smithi115
2022-01-24T19:16:56.847 INFO:teuthology.kill:2022-01-24 19:16:56,846.846 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2022-01-24T19:16:56.852 INFO:teuthology.kill:2022-01-24 19:16:56,852.852 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2022-01-24T19:16:56.991 INFO:teuthology.kill:2022-01-24 19:16:56,990.990 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2022-01-24T19:16:56.994 INFO:teuthology.kill:2022-01-24 19:16:56,994.994 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com
2022-01-24T19:18:57.198 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-24T19:18:57.297 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi110 but it was locked by another job: /home/teuthworker/archive/ksirivad-2022-01-24_19:09:07-rados:mgr-wip-kisirvad-mgr-progress-improve-test-distro-basic-smithi/6638696
2022-01-24T19:18:57.297 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi115 but it was locked by another job: /home/teuthworker/archive/ksirivad-2022-01-24_19:09:07-rados:mgr-wip-kisirvad-mgr-progress-improve-test-distro-basic-smithi/6638696