2021-11-23T17:52:59.162 INFO:root:teuthology version: 1.1.0-6cfddd5e
2021-11-23T17:52:59.338 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging
2021-11-23T17:52:59.339 INFO:teuthology.lock.ops:Updating [ubuntu@smithi043.front.sepia.ceph.com]: reset os type and version on server
2021-11-23T17:52:59.339 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2021-11-23T17:52:59.362 INFO:teuthology.lock.ops:Node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging is complete
2021-11-23T17:52:59.363 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging
2021-11-23T17:52:59.363 INFO:teuthology.lock.ops:Updating [ubuntu@smithi089.front.sepia.ceph.com]: reset os type and version on server
2021-11-23T17:52:59.363 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2021-11-23T17:52:59.383 INFO:teuthology.lock.ops:Node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging is complete
2021-11-23T17:52:59.383 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi174.front.sepia.ceph.com' reimaging
2021-11-23T17:52:59.383 INFO:teuthology.lock.ops:Updating [ubuntu@smithi174.front.sepia.ceph.com]: reset os type and version on server
2021-11-23T17:52:59.384 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2021-11-23T17:52:59.404 INFO:teuthology.lock.ops:Node 'ubuntu@smithi174.front.sepia.ceph.com' reimaging is complete
2021-11-23T17:52:59.594 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of ubuntu 20.04
2021-11-23T17:52:59.596 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of ubuntu 20.04
2021-11-23T17:52:59.626 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of ubuntu 20.04
2021-11-23T17:52:59.955 INFO:teuthology.orchestra.console:Power off smithi089
2021-11-23T17:52:59.999 INFO:teuthology.orchestra.console:Power off smithi174
2021-11-23T17:53:00.013 INFO:teuthology.orchestra.console:Power off smithi043
2021-11-23T17:53:08.371 INFO:teuthology.orchestra.console:Power off for smithi174 completed
2021-11-23T17:53:08.386 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-11-23T17:53:08.473 INFO:teuthology.orchestra.console:Power on smithi174
2021-11-23T17:53:08.487 INFO:teuthology.orchestra.console:Power on smithi043
2021-11-23T17:53:12.461 INFO:teuthology.orchestra.console:Power off for smithi089 completed
2021-11-23T17:53:12.564 INFO:teuthology.orchestra.console:Power on smithi089
2021-11-23T17:53:16.822 INFO:teuthology.orchestra.console:Power on for smithi089 completed
2021-11-23T17:53:16.838 INFO:teuthology.orchestra.console:Power on for smithi174 completed
2021-11-23T17:53:16.850 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2021-11-23T17:53:16.924 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish
2021-11-23T17:53:16.940 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish
2021-11-23T17:53:16.951 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2021-11-23T17:58:21.870 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-23T17:58:22.403 INFO:teuthology.provision.fog.smithi043:Node is ready
2021-11-23T17:58:22.410 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2021-11-23T17:58:22.418 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2021-11-23T17:58:22.633 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2021-11-23T17:58:36.932 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-23T17:58:37.460 INFO:teuthology.provision.fog.smithi174:Node is ready
2021-11-23T17:58:37.467 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com
2021-11-23T17:58:37.475 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174
2021-11-23T17:58:37.720 INFO:teuthology.provision.fog.smithi174:Deploy complete!
2021-11-23T17:58:52.148 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-23T17:58:52.643 INFO:teuthology.provision.fog.smithi089:Node is ready
2021-11-23T17:58:52.650 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com
2021-11-23T17:58:52.658 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089
2021-11-23T17:58:52.860 INFO:teuthology.provision.fog.smithi089:Deploy complete!
2021-11-23T17:58:53.085 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2021-11-23T17:58:53.086 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-23T17:58:53.104 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com
2021-11-23T17:58:53.105 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-23T17:58:53.122 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com
2021-11-23T17:58:53.123 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-23T17:58:53.145 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2021-11-23T17:58:53.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2021-11-23T17:58:53.426 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2021-11-23T17:58:53.433 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu"
2021-11-23T17:58:53.434 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-11-23T17:58:53.434 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu
2021-11-23T17:58:53.434 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian
2021-11-23T17:58:53.434 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-11-23T17:58:53.435 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="20.04"
2021-11-23T17:58:53.435 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/"
2021-11-23T17:58:53.435 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-11-23T17:58:53.435 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-11-23T17:58:53.435 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-11-23T17:58:53.436 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=focal
2021-11-23T17:58:53.436 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=focal
2021-11-23T17:58:53.437 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2021-11-23T17:58:53.457 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server
2021-11-23T17:58:53.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2021-11-23T17:58:53.618 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64
2021-11-23T17:58:53.624 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu"
2021-11-23T17:58:53.625 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-11-23T17:58:53.625 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu
2021-11-23T17:58:53.625 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian
2021-11-23T17:58:53.625 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-11-23T17:58:53.625 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="20.04"
2021-11-23T17:58:53.626 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/"
2021-11-23T17:58:53.626 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-11-23T17:58:53.626 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-11-23T17:58:53.626 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-11-23T17:58:53.627 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=focal
2021-11-23T17:58:53.627 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=focal
2021-11-23T17:58:53.627 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2021-11-23T17:58:53.645 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server
2021-11-23T17:58:53.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2021-11-23T17:58:53.822 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64
2021-11-23T17:58:53.828 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu"
2021-11-23T17:58:53.829 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-11-23T17:58:53.829 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu
2021-11-23T17:58:53.829 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian
2021-11-23T17:58:53.829 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-11-23T17:58:53.830 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="20.04"
2021-11-23T17:58:53.830 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/"
2021-11-23T17:58:53.830 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-11-23T17:58:53.830 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-11-23T17:58:53.830 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-11-23T17:58:53.831 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=focal
2021-11-23T17:58:53.831 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=focal
2021-11-23T17:58:53.831 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2021-11-23T17:58:53.967 INFO:teuthology.dispatcher.supervisor:Running job 6522876
2021-11-23T17:58:53.968 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2021-11-23_17:37:50-rados-wip-yuri7-testing-2021-11-22-0935-pacific-distro-basic-smithi/6522876 --name nojha-2021-11-23_17:37:50-rados-wip-yuri7-testing-2021-11-22-0935-pacific-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/nojha-2021-11-23_17:37:50-rados-wip-yuri7-testing-2021-11-22-0935-pacific-distro-basic-smithi/6522876/orig.config.yaml
2021-11-23T17:58:53.972 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2021-11-23_17:37:50-rados-wip-yuri7-testing-2021-11-22-0935-pacific-distro-basic-smithi/6522876
2021-11-23T17:58:53.973 INFO:teuthology.dispatcher.supervisor:Job PID: 29845
2021-11-23T17:58:53.973 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-24T05:59:49.631 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-24T05:59:49.780 INFO:teuthology.kill:Killing Pids: {29845}
2021-11-24T05:59:50.972 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2021-11-24T05:59:50.973 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2021-11-24T05:59:50.973 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2021-11-24T05:59:50.974 INFO:teuthology.misc:Compressing logs...
2021-11-24T05:59:50.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2021-11-24T05:59:51.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2021-11-24T05:59:51.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2021-11-24T05:59:51.606 INFO:teuthology.misc:Compressing logs...
2021-11-24T05:59:52.854 INFO:teuthology.misc:Compressing logs...
2021-11-24T06:02:26.542 INFO:teuthology.kill:No teuthology processes running
2021-11-24T06:02:27.644 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi089', 'smithi174']
2021-11-24T06:02:28.642 INFO:teuthology.kill:2021-11-24 06:02:28,642.642 INFO:teuthology.nuke:targets:
2021-11-24T06:02:28.643 INFO:teuthology.kill:  smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeO1OIuDT+INbRo6MRGnm4oFskNFmujT3JP2lTDuZDJ/1dr/BIzaS5wF/AOTrzv1G0ixPQ3r/vSQlWnQZQ3qpkEG4CZREGtCtZ+vSKZHzcyUPadzaeq6o/yixPYWXPfjjysTy1uRmyjNqmMyG9Sp+dio/UXu/eFyKI1YPA8v5VQyINRbiIWa6K7qkhB63FsrkCJB9GyQE4ZyWhlmUphtJD2DxB3ObXdW7G6yzVV7FMJl7Zo9BzN8BMw+B/S4tdv/3CFdEIQduy+wpUJkHnyd8rGoRVdT6w3t0dY4jN3XP1+2i/7mqOFhFkGTctNSuFtAsA5kx4oVSkUeA03IB2c7Vk/5fSfBK9fUncqSfxyLYmbSo5RxTmvXTlKNL+B6Uu7uE4xSgm/SR7fia4cHWOacTJax9XtX2swLQ7fZ8oE0A6iVeTtNaXmvc03FrAP2V+XWiHHEu2jqCchAHxtUu8nZro4YubgErV4qcSxjQozYWC2RRud2SvzylKfcoefqVY8t0=
2021-11-24T06:02:28.643 INFO:teuthology.kill:  smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+fsx0Kh49ALdOvWqRB31Ho/9+PXJIazq7wWfKxjPdPFPIJEmHAfUwslH31x1HwmJqjqIUWfMDGKd9xCzok0p02T4K/R8RM7mhYPPkFFYal1JiaMMmBKQkGt/amQ/wb5dYhMLXUsUM8pz7OBQPRYs90EGyGyc6krTgfmx0NMhBukWe6hSwEkF7wOJOjyW3jkiSpDlfVcZ3SMlp8BcpahHtOELuca+7JfZtWZaQwYzie+jiH316h6P9hdo8mIZFFGqkG1Sc6bazwUXNv3ParuH/CXYqvQ50sOOYfhSvYbGjIPPb4euAsy0ZiPgiYNMJicgCBGFzdFYacgSNzIDJ9hcy93zeewMp9qZWeknvQslyWj+nzLBm3K13QcJdnEaWucA+kUndO5tWS281MrU5mqhEUqfexZJ0YSoLJDYBNwCxJQoe2uCgtjKYMCRl4revlPu6+bMp3J9hA51ZKwFv68+5vFnq3r206XUGSLe9n3lt9hQm8o5040TWgE+NRRvGroU=
2021-11-24T06:02:28.644 INFO:teuthology.kill:  smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRowkH4YBBAies8zIFkLEtnm2H4c9TGJT2GDiybn1ffkG3B2w1w+4RB4AXyBB7Hho7NH+7awGz56TuvWL+sMw34aA3P8fACkSAx3yoyn+9vRXNF1ja1WqaJOLzgH9iaPfqS0sEemJHZfWivezzTDTPCwv8ud2Wg+nO8n4RiSmcmLXH7oEhARfylM9KxIt9XqNLpClcZP5YJVF5/qOCL0eNH+7aestV5lCm2xSl36MkELr6RB/7YSXRxd1VOx9m2e/dPt3z8IrxlJrQO/eLRl1A6CVt3rUofvcfgM70IAg1nWif2XaxH+QASlSnGSalz/4Oi9HETB97nCblMzHzBXf8GtTHhLv5qbGoMZ/nnnXvKFtLgmDbawvzGtfgSDBfj1X8rljrqVFy1ZnHeqgfp1fw3PG8SRodOlOiyDd7DVXbmC+tS66/TPJNh+8qcSlU0kVTkGC7Cxoq7fxKdpZGmjn0K5gdLYraU7Yh7izE/aaxqeVnzQRcrQEpQQ7WD6ohDHc=
2021-11-24T06:02:28.671 INFO:teuthology.kill:2021-11-24 06:02:28,671.671 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-24T06:02:28.678 INFO:teuthology.kill:2021-11-24 06:02:28,678.678 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-24T06:02:28.693 INFO:teuthology.kill:2021-11-24 06:02:28,692.692 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-24T06:02:28.753 INFO:teuthology.kill:2021-11-24 06:02:28,753.753 INFO:teuthology.orchestra.console:Power off smithi043
2021-11-24T06:02:28.769 INFO:teuthology.kill:2021-11-24 06:02:28,768.768 INFO:teuthology.orchestra.console:Power off smithi174
2021-11-24T06:02:28.792 INFO:teuthology.kill:2021-11-24 06:02:28,792.792 INFO:teuthology.orchestra.console:Power off smithi089
2021-11-24T06:02:37.134 INFO:teuthology.kill:2021-11-24 06:02:37,134.134 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-11-24T06:02:37.152 INFO:teuthology.kill:2021-11-24 06:02:37,152.152 INFO:teuthology.orchestra.console:Power off for smithi089 completed
2021-11-24T06:02:37.288 INFO:teuthology.kill:2021-11-24 06:02:37,287.287 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2021-11-24T06:02:37.307 INFO:teuthology.kill:2021-11-24 06:02:37,307.307 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com
2021-11-24T06:02:41.251 INFO:teuthology.kill:2021-11-24 06:02:41,251.251 INFO:teuthology.orchestra.console:Power off for smithi174 completed
2021-11-24T06:02:41.399 INFO:teuthology.kill:2021-11-24 06:02:41,399.399 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com
2021-11-24T06:04:41.749 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-24T06:04:41.883 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi043 but it was locked by another job: /home/teuthworker/archive/ifed01-2021-11-23_22:21:23-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6523024
2021-11-24T06:04:41.884 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi089 but it was locked by another job: /home/teuthworker/archive/ifed01-2021-11-23_22:21:23-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6523024
2021-11-24T06:04:41.884 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi174 but it was locked by another job: /home/teuthworker/archive/ifed01-2021-11-23_22:21:23-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6523027