2022-01-20T12:45:14.596 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-20T12:45:14.720 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging
2022-01-20T12:45:14.721 INFO:teuthology.lock.ops:Updating [ubuntu@smithi196.front.sepia.ceph.com]: reset os type and version on server
2022-01-20T12:45:14.722 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2022-01-20T12:45:14.741 INFO:teuthology.lock.ops:Node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging is complete
2022-01-20T12:45:14.741 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging
2022-01-20T12:45:14.741 INFO:teuthology.lock.ops:Updating [ubuntu@smithi201.front.sepia.ceph.com]: reset os type and version on server
2022-01-20T12:45:14.742 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2022-01-20T12:45:14.760 INFO:teuthology.lock.ops:Node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging is complete
2022-01-20T12:45:14.952 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream
2022-01-20T12:45:14.979 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of centos 8.stream
2022-01-20T12:45:15.316 INFO:teuthology.orchestra.console:Power off smithi196
2022-01-20T12:45:15.377 INFO:teuthology.orchestra.console:Power off smithi201
2022-01-20T12:45:23.690 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2022-01-20T12:45:23.791 INFO:teuthology.orchestra.console:Power on smithi196
2022-01-20T12:45:27.856 INFO:teuthology.orchestra.console:Power off for smithi201 completed
2022-01-20T12:45:27.959 INFO:teuthology.orchestra.console:Power on smithi201
2022-01-20T12:45:32.157 INFO:teuthology.orchestra.console:Power on for smithi196 completed
2022-01-20T12:45:32.212 INFO:teuthology.orchestra.console:Power on for smithi201 completed
2022-01-20T12:45:32.259 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2022-01-20T12:45:32.313 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish
2022-01-20T12:49:32.186 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-20T12:49:57.205 INFO:teuthology.provision.fog.smithi201:Node is ready
2022-01-20T12:49:57.224 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com
2022-01-20T12:49:57.280 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201
2022-01-20T12:49:57.631 INFO:teuthology.provision.fog.smithi201:Deploy complete!
2022-01-20T12:50:22.696 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-20T12:50:22.977 INFO:teuthology.provision.fog.smithi196:Node is ready
2022-01-20T12:50:22.997 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2022-01-20T12:50:23.055 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2022-01-20T12:50:23.405 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2022-01-20T12:50:23.554 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2022-01-20T12:50:23.555 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-20T12:50:23.574 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com
2022-01-20T12:50:23.574 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-20T12:50:23.593 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2022-01-20T12:50:23.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2022-01-20T12:50:23.787 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2022-01-20T12:50:23.843 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2022-01-20T12:50:23.845 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2022-01-20T12:50:23.845 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2022-01-20T12:50:23.845 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2022-01-20T12:50:23.845 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2022-01-20T12:50:23.845 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2022-01-20T12:50:23.846 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-20T12:50:23.846 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2022-01-20T12:50:23.846 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-20T12:50:23.846 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2022-01-20T12:50:23.847 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-20T12:50:23.847 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-20T12:50:23.847 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-20T12:50:23.849 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2022-01-20T12:50:23.866 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server
2022-01-20T12:50:23.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com'
2022-01-20T12:50:24.069 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64
2022-01-20T12:50:24.127 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="CentOS Stream"
2022-01-20T12:50:24.127 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="8"
2022-01-20T12:50:24.128 INFO:teuthology.orchestra.run.smithi201.stdout:ID="centos"
2022-01-20T12:50:24.128 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE="rhel fedora"
2022-01-20T12:50:24.129 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="8"
2022-01-20T12:50:24.129 INFO:teuthology.orchestra.run.smithi201.stdout:PLATFORM_ID="platform:el8"
2022-01-20T12:50:24.129 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-20T12:50:24.129 INFO:teuthology.orchestra.run.smithi201.stdout:ANSI_COLOR="0;31"
2022-01-20T12:50:24.130 INFO:teuthology.orchestra.run.smithi201.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-20T12:50:24.130 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://centos.org/"
2022-01-20T12:50:24.130 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-20T12:50:24.130 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-20T12:50:24.131 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-20T12:50:24.131 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2022-01-20T12:50:24.228 INFO:teuthology.dispatcher.supervisor:Running job 6623953
2022-01-20T12:50:24.229 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_ifed01@teuthology --archive /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623953 --name ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623953/orig.config.yaml
2022-01-20T12:50:24.232 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623953
2022-01-20T12:50:24.232 INFO:teuthology.dispatcher.supervisor:Job PID: 30448
2022-01-20T12:50:24.233 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-20T19:20:53.472 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-20T19:20:53.662 INFO:teuthology.kill:Killing Pids: {30448}
2022-01-20T19:20:54.870 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-20T19:20:54.871 INFO:teuthology.task.internal:roles: ubuntu@smithi201.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-20T19:20:54.871 INFO:teuthology.misc:Compressing logs...
2022-01-20T19:20:54.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2022-01-20T19:20:55.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com'
2022-01-20T19:20:55.113 INFO:teuthology.orchestra.run.smithi196.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-20T19:20:55.304 INFO:teuthology.orchestra.run.smithi201.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-20T19:20:55.338 INFO:teuthology.orchestra.run.smithi196.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-20T19:20:55.338 INFO:teuthology.orchestra.run.smithi196.stderr:tar: Error is not recoverable: exiting now
2022-01-20T19:20:55.369 INFO:teuthology.orchestra.run.smithi201.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-20T19:20:55.370 INFO:teuthology.orchestra.run.smithi201.stderr:tar: Error is not recoverable: exiting now
2022-01-20T19:20:55.371 INFO:teuthology.misc:Compressing logs...
2022-01-20T19:20:55.583 INFO:teuthology.misc:Compressing logs...
2022-01-20T19:20:59.154 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-mon.smithi201.log: file size changed while zipping
2022-01-20T19:21:04.867 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-mon.smithi196.log: file size changed while zipping
2022-01-20T19:21:06.463 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-20T19:21:06.568 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-mgr.smithi196.dxfbyt.log: file size changed while zipping
2022-01-20T19:21:14.563 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-20T19:21:15.492 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-20T19:21:21.826 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-20T19:21:24.414 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-20T19:21:31.404 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-20T19:21:31.585 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-20T19:21:38.883 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/9ed2b8fa-79f0-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-20T19:21:55.834 INFO:teuthology.kill:No teuthology processes running
2022-01-20T19:21:57.028 INFO:teuthology.kill:Nuking machines: ['smithi196', 'smithi201']
2022-01-20T19:21:58.015 INFO:teuthology.kill:2022-01-20 19:21:58,014.014 INFO:teuthology.nuke:targets:
2022-01-20T19:21:58.015 INFO:teuthology.kill:  smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnmb68Zyh12rx/NbyD2JuMmRLpj4ekjNFFJZTNhDQlJCX7tYMKFcKnt11pP9jUCEkwbxb/pPRLbYoIrQL87EL57X+cZvUF1YP9lVAYPOPOJlGoYDPkt507E3JHElnjF2u07VA+fTj3b/OBBjqitzcgw7YldYXLNs77ufQ2eEJlanYLcekFt62J/RGXuKfnuNe6mTjjEKPpPieMzeQd0YiYxUPqnvur7cdiFeG8ILU/FpvYh6WpMbvwWrDPHZ0cWLdgkB3W2NrMT92FWIFQ/64goXHhfFl0q6xNuZHUjdCxjRLE+W+ou6NlqYgIJvkgk+6B5IzQNvhlHxqpuxAuJKbAwmU2GWI+lYEZnesecllNu9L0Qw0VAQAVcH8rdTIp8454T26vLNkP3s4/OmnubNJzzpiJlkOjeCnw08MAIxrUEIzcz8ELBD5uRUOe6RE0875UHN3jRdUOctRhkRGM8cIkYWY5fextJ5LO+D3AHV/CZsyF6sO03GJiFmk1aNibGs0=
2022-01-20T19:21:58.016 INFO:teuthology.kill:  smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQNB7c7GErFDsCAxm9awF3UNOqznO613zBlgt/Ls7EOBswnbFnMNz+/xqDeYn1UFIrqmNN9AuNW/urCtZ/Wfs9HLsnS5OGjC21wbXNmTLEXIC5VOUsx/d/hgaubCmF0d553SHV3m6BKtLvXFBlLl/mp/yzOVK2W6JTDh0RIz7Iu+Evn5zpAztaDxpDf/5vQ9kSm8HD14McFZHaWXhMyBEjBX45k/tUK52fgbGAVjW0H33mkV3aX8gElOcmtVcjeTdIeJSMJKTe4gTD+aRr/zV8ql4vCmQIDEIKpVD81DtgZ1N1CExQrNaGAVL2s4vC+dHEDsWx54FJzdYGxxjvT843XbFYdY9VoiErOtjSjj6Wt/bj4UEUjNgwq9Dz+ARHkUzXMr54YDdJwoFoqOunWfLbob0IYRSzuZXMDjG8Ma0iS7/auGKxM8O/upoZYYim0BYxtzAA3IpMFCV8+vnpvJello2rJZaOXb0rAqmcPYKiZxwB/vAuCSAMmdD0LuegQXU=
2022-01-20T19:21:58.041 INFO:teuthology.kill:2022-01-20 19:21:58,041.041 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-20T19:21:58.046 INFO:teuthology.kill:2022-01-20 19:21:58,046.046 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-20T19:21:58.115 INFO:teuthology.kill:2022-01-20 19:21:58,114.114 INFO:teuthology.orchestra.console:Power off smithi201
2022-01-20T19:21:58.129 INFO:teuthology.kill:2022-01-20 19:21:58,129.129 INFO:teuthology.orchestra.console:Power off smithi196
2022-01-20T19:22:06.499 INFO:teuthology.kill:2022-01-20 19:22:06,499.499 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2022-01-20T19:22:06.647 INFO:teuthology.kill:2022-01-20 19:22:06,646.646 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com
2022-01-20T19:22:10.607 INFO:teuthology.kill:2022-01-20 19:22:10,606.606 INFO:teuthology.orchestra.console:Power off for smithi201 completed
2022-01-20T19:22:10.753 INFO:teuthology.kill:2022-01-20 19:22:10,752.752 INFO:teuthology.lock.ops:unlocked: smithi201.front.sepia.ceph.com
2022-01-20T19:24:11.062 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-20T19:24:11.157 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi196 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-20_17:34:11-fs-wip-yuri5-testing-2022-01-20-0652-pacific-distro-default-smithi/6629372
2022-01-20T19:24:11.158 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi201 but it was locked by another job: /home/teuthworker/archive/aemerson-2022-01-20_18:59:04-rgw-wip-53941-distro-basic-smithi/6629925