2022-08-14T20:29:46.826 INFO:root:teuthology version: 1.1.1.dev409+g9e7483cc 2022-08-14T20:29:47.042 INFO:teuthology.lock.ops:Start node 'smithi085.front.sepia.ceph.com' reimaging 2022-08-14T20:29:47.044 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: reset os type and version on server 2022-08-14T20:29:47.044 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-08-14T20:29:47.065 INFO:teuthology.lock.ops:Node 'smithi085.front.sepia.ceph.com' reimaging is complete 2022-08-14T20:29:47.066 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2022-08-14T20:29:47.066 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2022-08-14T20:29:47.067 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2022-08-14T20:29:47.094 INFO:teuthology.lock.ops:Node 'smithi111.front.sepia.ceph.com' reimaging is complete 2022-08-14T20:29:47.312 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of centos 8.stream 2022-08-14T20:29:47.338 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.stream 2022-08-14T20:29:47.703 INFO:teuthology.orchestra.console:Power off smithi085 2022-08-14T20:29:47.723 INFO:teuthology.orchestra.console:Power off smithi111 2022-08-14T20:29:56.103 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-08-14T20:29:56.205 INFO:teuthology.orchestra.console:Power on smithi085 2022-08-14T20:30:00.220 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2022-08-14T20:30:00.321 INFO:teuthology.orchestra.console:Power on smithi111 2022-08-14T20:30:04.575 INFO:teuthology.orchestra.console:Power on for smithi085 completed 2022-08-14T20:30:04.580 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2022-08-14T20:30:04.677 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish 2022-08-14T20:30:04.680 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2022-08-14T20:34:50.251 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-14T20:35:02.343 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-14T20:35:15.936 INFO:teuthology.provision.fog.smithi111:Node is ready 2022-08-14T20:35:15.962 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2022-08-14T20:35:16.024 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2022-08-14T20:35:16.410 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2022-08-14T20:35:27.850 INFO:teuthology.provision.fog.smithi085:Node is ready 2022-08-14T20:35:27.873 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com 2022-08-14T20:35:27.937 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085 2022-08-14T20:35:28.308 INFO:teuthology.provision.fog.smithi085:Deploy complete! 2022-08-14T20:35:28.576 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com 2022-08-14T20:35:28.577 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-14T20:35:28.599 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2022-08-14T20:35:28.600 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-14T20:35:28.622 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server 2022-08-14T20:35:28.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-08-14T20:35:28.831 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2022-08-14T20:35:28.889 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream" 2022-08-14T20:35:28.889 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8" 2022-08-14T20:35:28.890 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos" 2022-08-14T20:35:28.890 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora" 2022-08-14T20:35:28.890 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8" 2022-08-14T20:35:28.891 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8" 2022-08-14T20:35:28.891 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8" 2022-08-14T20:35:28.891 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31" 2022-08-14T20:35:28.891 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-08-14T20:35:28.891 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/" 2022-08-14T20:35:28.892 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-14T20:35:28.892 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-14T20:35:28.892 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-08-14T20:35:28.894 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-08-14T20:35:28.914 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2022-08-14T20:35:28.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2022-08-14T20:35:29.180 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2022-08-14T20:35:29.238 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2022-08-14T20:35:29.239 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2022-08-14T20:35:29.239 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2022-08-14T20:35:29.239 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2022-08-14T20:35:29.240 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2022-08-14T20:35:29.240 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2022-08-14T20:35:29.240 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2022-08-14T20:35:29.240 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2022-08-14T20:35:29.241 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-08-14T20:35:29.241 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2022-08-14T20:35:29.241 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-14T20:35:29.241 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-14T20:35:29.241 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-08-14T20:35:29.242 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2022-08-14T20:35:29.356 INFO:teuthology.dispatcher.supervisor:Running job 6969361 2022-08-14T20:35:29.357 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-08-12_09:34:24-fs-wip-vshankar-testing1-20220812-072441-testing-default-smithi/6969361 --name vshankar-2022-08-12_09:34:24-fs-wip-vshankar-testing1-20220812-072441-testing-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/vshankar-2022-08-12_09:34:24-fs-wip-vshankar-testing1-20220812-072441-testing-default-smithi/6969361/orig.config.yaml 2022-08-14T20:35:29.362 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-08-12_09:34:24-fs-wip-vshankar-testing1-20220812-072441-testing-default-smithi/6969361 2022-08-14T20:35:29.364 INFO:teuthology.dispatcher.supervisor:Job PID: 14464 2022-08-14T20:35:29.364 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-08-15T08:36:25.063 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-08-15T08:36:25.241 INFO:teuthology.kill:Killing Pids: {14464} 2022-08-15T08:36:26.708 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-08-15T08:36:26.709 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-08-15T08:36:26.709 INFO:teuthology.misc:Compressing logs... 2022-08-15T08:36:26.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-08-15T08:36:26.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2022-08-15T08:36:27.333 INFO:teuthology.misc:Compressing logs... 2022-08-15T08:36:38.584 INFO:teuthology.misc:Compressing logs... 2022-08-15T08:37:22.714 INFO:teuthology.orchestra.run.smithi085.stderr:tar: .: file changed as we read it 2022-08-15T08:37:56.676 INFO:teuthology.kill:No teuthology processes running 2022-08-15T08:37:58.081 INFO:teuthology.kill:Nuking machines: ['smithi085', 'smithi111'] 2022-08-15T08:37:59.203 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-08-15T08:37:59.205 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-08-15T08:37:59.205 INFO:teuthology.kill:2022-08-15 08:37:59,203.203 INFO:teuthology.nuke:targets: 2022-08-15T08:37:59.206 INFO:teuthology.kill: smithi085.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKX313ADj2z/AP44qLUKNjJdUQzq4qyKu+5eT7IXEk93cmK5os+CfnWNUtOyliI8wdGAUj2nnw/vDRCCSB40aoY= 2022-08-15T08:37:59.207 INFO:teuthology.kill: smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtRKQi7nH2WwJgGZFuTYoN2nJjrq517Jn+j4KtC/q4Apu9n1C8Auwcof5RPvUp5HxmACgZ82OrHgyx9zVIuKV01TuTd79BJt55HHb5Ef/hefabasQtBux1p5yB15KG/9YboXQdzg4NKACMv2NtkMsJH5qoKn/Z5GUiFdFXkD4YYS8kh9mdzxbbbkMGJeb/8LE8NbFFkrYqEf3HFvngxDO2Oz9Veq3x+FfUEFYvkGdC6S+VDAc0Bgn1vbLyp3FTR1MVxGKxO7JYoP2epW7dniapwJkRU2Vsu+1ZFtnK5AcQ1ZgEUIL3dq8srGJ0wWGL7pEdFln1Fkm1xf6QSIJvCdnV5eMP0CrLKu7N+raeYhfqLbFo3aO6lIHu0JhkMG15ZlzF1jcV41+qw9pz6qTWmfNO5SzvAPDmWbhDeO7Yp+kpXHNM5k+qwzajvdae/YIXiTuHY0IEwNLWkchYt2dvQvqF7P0qoesKT1i8kKiTvTxf/ka6HoyoEpnSTfUOpBzF2s8= 2022-08-15T08:37:59.207 INFO:teuthology.kill:2022-08-15 08:37:59,203.203 INFO:teuthology.nuke:Checking targets against current locks 2022-08-15T08:37:59.279 INFO:teuthology.kill:2022-08-15 08:37:59,279.279 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-15T08:37:59.331 INFO:teuthology.kill:2022-08-15 08:37:59,331.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-15T08:37:59.403 INFO:teuthology.kill:2022-08-15 08:37:59,402.402 INFO:teuthology.orchestra.console:Power off smithi085 2022-08-15T08:37:59.464 INFO:teuthology.kill:2022-08-15 08:37:59,463.463 INFO:teuthology.orchestra.console:Power off smithi111 2022-08-15T08:38:07.836 INFO:teuthology.kill:2022-08-15 08:38:07,835.835 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-08-15T08:38:08.027 INFO:teuthology.kill:2022-08-15 08:38:08,026.026 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com 2022-08-15T08:38:11.984 INFO:teuthology.kill:2022-08-15 08:38:11,984.984 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2022-08-15T08:38:12.142 INFO:teuthology.kill:2022-08-15 08:38:12,142.142 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2022-08-15T08:40:12.483 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-08-15T08:40:12.601 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-08-12_09:34:24-fs-wip-vshankar-testing1-20220812-072441-testing-default-smithi/6969507 2022-08-15T08:40:12.601 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-08-12_09:34:24-fs-wip-vshankar-testing1-20220812-072441-testing-default-smithi/6969507