2022-01-15T05:53:39.621 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-15T05:53:39.746 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi001.front.sepia.ceph.com' reimaging
2022-01-15T05:53:39.747 INFO:teuthology.lock.ops:Updating [ubuntu@smithi001.front.sepia.ceph.com]: reset os type and version on server
2022-01-15T05:53:39.748 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2022-01-15T05:53:39.766 INFO:teuthology.lock.ops:Node 'ubuntu@smithi001.front.sepia.ceph.com' reimaging is complete
2022-01-15T05:53:39.767 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging
2022-01-15T05:53:39.768 INFO:teuthology.lock.ops:Updating [ubuntu@smithi079.front.sepia.ceph.com]: reset os type and version on server
2022-01-15T05:53:39.768 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2022-01-15T05:53:39.790 INFO:teuthology.lock.ops:Node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging is complete
2022-01-15T05:53:39.995 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of rhel 8.4
2022-01-15T05:53:40.025 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.4
2022-01-15T05:53:40.384 INFO:teuthology.orchestra.console:Power off smithi001
2022-01-15T05:53:40.475 INFO:teuthology.orchestra.console:Power off smithi079
2022-01-15T05:53:48.753 INFO:teuthology.orchestra.console:Power off for smithi001 completed
2022-01-15T05:53:48.854 INFO:teuthology.orchestra.console:Power on smithi001
2022-01-15T05:53:52.957 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2022-01-15T05:53:53.059 INFO:teuthology.orchestra.console:Power on smithi079
2022-01-15T05:53:57.218 INFO:teuthology.orchestra.console:Power on for smithi001 completed
2022-01-15T05:53:57.319 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish
2022-01-15T05:54:01.422 INFO:teuthology.orchestra.console:Power on for smithi079 completed
2022-01-15T05:54:01.523 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2022-01-15T05:58:32.039 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-15T05:58:32.273 INFO:teuthology.provision.fog.smithi001:Node is ready
2022-01-15T05:58:32.290 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com
2022-01-15T05:58:32.348 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001
2022-01-15T05:58:32.684 INFO:teuthology.provision.fog.smithi001:Deploy complete!
2022-01-15T05:59:06.624 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-15T05:59:06.840 INFO:teuthology.provision.fog.smithi079:Node is ready
2022-01-15T05:59:06.854 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2022-01-15T05:59:06.909 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2022-01-15T05:59:07.233 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2022-01-15T05:59:07.383 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com
2022-01-15T05:59:07.384 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-15T05:59:07.402 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2022-01-15T05:59:07.402 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-15T05:59:07.421 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server
2022-01-15T05:59:07.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2022-01-15T05:59:07.662 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64
2022-01-15T05:59:07.718 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux"
2022-01-15T05:59:07.718 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.4 (Ootpa)"
2022-01-15T05:59:07.719 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel"
2022-01-15T05:59:07.719 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora"
2022-01-15T05:59:07.719 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.4"
2022-01-15T05:59:07.719 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2022-01-15T05:59:07.719 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-15T05:59:07.720 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2022-01-15T05:59:07.720 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-15T05:59:07.720 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/"
2022-01-15T05:59:07.720 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-15T05:59:07.721 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-15T05:59:07.721 INFO:teuthology.orchestra.run.smithi001.stdout:
2022-01-15T05:59:07.721 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-15T05:59:07.721 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-15T05:59:07.722 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-15T05:59:07.722 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-15T05:59:07.723 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2022-01-15T05:59:07.741 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2022-01-15T05:59:07.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2022-01-15T05:59:07.923 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2022-01-15T05:59:07.976 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux"
2022-01-15T05:59:07.977 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.4 (Ootpa)"
2022-01-15T05:59:07.977 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel"
2022-01-15T05:59:07.977 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora"
2022-01-15T05:59:07.977 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.4"
2022-01-15T05:59:07.977 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2022-01-15T05:59:07.978 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-15T05:59:07.978 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2022-01-15T05:59:07.978 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-15T05:59:07.978 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/"
2022-01-15T05:59:07.979 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-15T05:59:07.979 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-15T05:59:07.979 INFO:teuthology.orchestra.run.smithi079.stdout:
2022-01-15T05:59:07.979 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-15T05:59:07.980 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-15T05:59:07.980 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-15T05:59:07.980 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-15T05:59:07.981 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2022-01-15T05:59:08.072 INFO:teuthology.dispatcher.supervisor:Running job 6618826
2022-01-15T05:59:08.072 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6618826 --name yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6618826/orig.config.yaml
2022-01-15T05:59:08.076 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6618826
2022-01-15T05:59:08.077 INFO:teuthology.dispatcher.supervisor:Job PID: 18899
2022-01-15T05:59:08.077 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-15T12:29:19.263 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-15T12:29:19.440 INFO:teuthology.kill:Killing Pids: {18899}
2022-01-15T12:29:20.645 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-15T12:29:20.646 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-15T12:29:20.646 INFO:teuthology.misc:Compressing logs...
2022-01-15T12:29:20.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2022-01-15T12:29:20.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2022-01-15T12:29:20.861 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-15T12:29:21.094 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-15T12:29:21.135 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-15T12:29:21.135 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now
2022-01-15T12:29:21.198 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-15T12:29:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now
2022-01-15T12:29:21.200 INFO:teuthology.misc:Compressing logs...
2022-01-15T12:29:21.393 INFO:teuthology.misc:Compressing logs...
2022-01-15T12:29:37.687 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-15T12:29:39.771 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-15T12:29:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-mgr.smithi001.hhwckz.log: file size changed while zipping
2022-01-15T12:29:42.896 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-mon.smithi079.log: file size changed while zipping
2022-01-15T12:29:49.646 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-mon.smithi001.log: file size changed while zipping
2022-01-15T12:29:53.709 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-15T12:30:06.741 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-15T12:30:11.389 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-15T12:30:24.915 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-15T12:30:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-15T12:30:47.269 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/d5ab3f80-75c9-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-15T12:31:18.790 INFO:teuthology.kill:No teuthology processes running
2022-01-15T12:31:19.982 INFO:teuthology.kill:Nuking machines: ['smithi001', 'smithi079']
2022-01-15T12:31:21.017 INFO:teuthology.kill:2022-01-15 12:31:21,016.016 INFO:teuthology.nuke:targets:
2022-01-15T12:31:21.018 INFO:teuthology.kill:  smithi001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC21ZwIdEdoFTc3FwmKxPAJCGSd+Je8tMEd+DcmEtmwDL9LzFVVTsF2iZ1ENS6t2CNDegzHqslbAvV5cDlpBA4AZoRIgxZeh7KSBTgeHN/sJWDfDa1XWU5YNY+GMlU3cjecSyYMh8lj0y5ddXsfPVbD5xnnyD76JRaBkGfDTQNixlMwLKhTkg5bjsHlGEY772gHIJ044L6AeqaSyKLE6Mckt+c/xLrGSUBql4BTZ+EvIaXuAoIaFP487Ein45siBIZuSFNX+B5ViWSmVXlFqEens1pTRa+QRou2tM4WHG3cuvZ6hrFsLao0Nd/zEs2VROcf+KntpLgbdxcNe8X1q/SCGjeScibWYhoLBJq07CtrShdWVug/pE7IllRXj5TMqIJJQuAIOKQ1Dd62uEH6BtNfeQ9AwzbSDxXSLwURxN9zcAaErTzbf4I7wok3ASBhrqUHZV7i3o5QeUPI7tCWrTYzmdUZTczLUBdT1EJPU/+NuHBpwu992QC4ud200CH+l7c=
2022-01-15T12:31:21.018 INFO:teuthology.kill:  smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFtQmjTIsruoB/mUW+Y4Yo5nwdVpVeH79fuwj4DrsUKd3+fvrkl+EV1zu8GSu2wD1KjWYeF7yJ5b/qsasi8lg2nfv5F699kvystjboWNXOtxbh4qeOJ5ch4f+7E1+/QZT9m0juHnPXOq8HfNaCE+4gfkhrmrViwNykL5Eda2f41vmW5evlnwTlyTo4UcvTw3L/DI2tEnnj39VJGSw5jP20YQJPRTDkNZ1RmIyZPChp/ic9HtmviWlFoijnalmCTzztdt9xNbhDGG4l/rSuqB9r6smg9XU3it/O8e9dPnngfzcOoaUCDTHSgS5BDkhyJsmRGmqFh1/V2jS0Ddr3HsE27Gmq1EL2ExsvBLCBMZT8dGJlu7fdc5ScAl4+ndbxAljCja4dFRS5E+ypGLtzqGoh7NHTx8tnEPekQaHd0h0Zc7HlAn77MZPTrTdrr65tMMn0jNequfyaZFi7vR3caV0NeT5nqKRwT2d6VBhtCWAEBxwca+PctXIdDslNwB1yOIU=
2022-01-15T12:31:21.047 INFO:teuthology.kill:2022-01-15 12:31:21,047.047 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-15T12:31:21.051 INFO:teuthology.kill:2022-01-15 12:31:21,051.051 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-15T12:31:21.131 INFO:teuthology.kill:2022-01-15 12:31:21,130.130 INFO:teuthology.orchestra.console:Power off smithi001
2022-01-15T12:31:21.143 INFO:teuthology.kill:2022-01-15 12:31:21,143.143 INFO:teuthology.orchestra.console:Power off smithi079
2022-01-15T12:31:29.509 INFO:teuthology.kill:2022-01-15 12:31:29,509.509 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2022-01-15T12:31:29.655 INFO:teuthology.kill:2022-01-15 12:31:29,654.654 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com
2022-01-15T12:31:33.617 INFO:teuthology.kill:2022-01-15 12:31:33,616.616 INFO:teuthology.orchestra.console:Power off for smithi001 completed
2022-01-15T12:31:33.766 INFO:teuthology.kill:2022-01-15 12:31:33,765.765 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com
2022-01-15T12:33:34.094 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-15T12:33:34.190 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi001 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619466
2022-01-15T12:33:34.191 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi079 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619466