2021-05-31T17:36:33.845 INFO:root:teuthology version: 1.1.0-f359b10d 2021-05-31T17:36:33.937 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi019.front.sepia.ceph.com' reimaging 2021-05-31T17:36:33.938 INFO:teuthology.lock.ops:Updating [ubuntu@smithi019.front.sepia.ceph.com]: reset os type and version on server 2021-05-31T17:36:33.938 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2021-05-31T17:36:33.953 INFO:teuthology.lock.ops:Node 'ubuntu@smithi019.front.sepia.ceph.com' reimaging is complete 2021-05-31T17:36:33.954 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi095.front.sepia.ceph.com' reimaging 2021-05-31T17:36:33.954 INFO:teuthology.lock.ops:Updating [ubuntu@smithi095.front.sepia.ceph.com]: reset os type and version on server 2021-05-31T17:36:33.955 INFO:teuthology.lock.ops:Updating smithi095.front.sepia.ceph.com on lock server 2021-05-31T17:36:33.972 INFO:teuthology.lock.ops:Node 'ubuntu@smithi095.front.sepia.ceph.com' reimaging is complete 2021-05-31T17:36:34.149 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 8.2 2021-05-31T17:36:34.176 INFO:teuthology.provision.fog.smithi095:Scheduling deploy of centos 8.2 2021-05-31T17:36:34.441 INFO:teuthology.orchestra.console:Power off smithi019 2021-05-31T17:36:34.479 INFO:teuthology.orchestra.console:Power off smithi095 2021-05-31T17:36:34.590 INFO:teuthology.orchestra.console:Power off for smithi019 completed 2021-05-31T17:36:34.626 INFO:teuthology.orchestra.console:Power off for smithi095 completed 2021-05-31T17:36:34.692 INFO:teuthology.orchestra.console:Power on smithi019 2021-05-31T17:36:34.727 INFO:teuthology.orchestra.console:Power on smithi095 2021-05-31T17:36:43.060 INFO:teuthology.orchestra.console:Power on for smithi019 completed 2021-05-31T17:36:43.162 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2021-05-31T17:36:43.202 INFO:teuthology.orchestra.console:Power on for smithi095 completed 2021-05-31T17:36:43.303 INFO:teuthology.provision.fog.smithi095:Waiting for deploy to finish 2021-05-31T17:41:12.197 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-31T17:41:12.489 INFO:teuthology.provision.fog.smithi019:Node is ready 2021-05-31T17:41:12.505 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2021-05-31T17:41:12.561 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2021-05-31T17:41:12.880 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2021-05-31T17:41:14.970 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-31T17:41:15.300 INFO:teuthology.provision.fog.smithi095:Node is ready 2021-05-31T17:41:15.317 INFO:teuthology.orchestra.run.smithi095.stdout:smithi095.front.sepia.ceph.com 2021-05-31T17:41:15.372 INFO:teuthology.orchestra.run.smithi095.stdout:172.21.15.95 smithi095.front.sepia.ceph.com smithi095 2021-05-31T17:41:15.694 INFO:teuthology.provision.fog.smithi095:Deploy complete! 2021-05-31T17:41:15.844 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2021-05-31T17:41:15.845 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-31T17:41:15.860 INFO:teuthology.lock.ops:Checking smithi095.front.sepia.ceph.com 2021-05-31T17:41:15.861 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-31T17:41:15.876 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2021-05-31T17:41:15.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-31T17:41:16.158 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2021-05-31T17:41:16.213 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Linux" 2021-05-31T17:41:16.214 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8 (Core)" 2021-05-31T17:41:16.214 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2021-05-31T17:41:16.214 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2021-05-31T17:41:16.215 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8" 2021-05-31T17:41:16.215 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8" 2021-05-31T17:41:16.215 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-05-31T17:41:16.215 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2021-05-31T17:41:16.216 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-05-31T17:41:16.216 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.centos.org/" 2021-05-31T17:41:16.216 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-05-31T17:41:16.216 INFO:teuthology.orchestra.run.smithi019.stdout: 2021-05-31T17:41:16.217 INFO:teuthology.orchestra.run.smithi019.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-05-31T17:41:16.217 INFO:teuthology.orchestra.run.smithi019.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-05-31T17:41:16.217 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-05-31T17:41:16.217 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-05-31T17:41:16.217 INFO:teuthology.orchestra.run.smithi019.stdout: 2021-05-31T17:41:16.219 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2021-05-31T17:41:16.242 INFO:teuthology.lock.ops:Updating [smithi095.front.sepia.ceph.com]: set os type and version on server 2021-05-31T17:41:16.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-31T17:41:16.507 INFO:teuthology.orchestra.run.smithi095.stdout:x86_64 2021-05-31T17:41:16.561 INFO:teuthology.orchestra.run.smithi095.stdout:NAME="CentOS Linux" 2021-05-31T17:41:16.562 INFO:teuthology.orchestra.run.smithi095.stdout:VERSION="8 (Core)" 2021-05-31T17:41:16.562 INFO:teuthology.orchestra.run.smithi095.stdout:ID="centos" 2021-05-31T17:41:16.563 INFO:teuthology.orchestra.run.smithi095.stdout:ID_LIKE="rhel fedora" 2021-05-31T17:41:16.563 INFO:teuthology.orchestra.run.smithi095.stdout:VERSION_ID="8" 2021-05-31T17:41:16.564 INFO:teuthology.orchestra.run.smithi095.stdout:PLATFORM_ID="platform:el8" 2021-05-31T17:41:16.564 INFO:teuthology.orchestra.run.smithi095.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-05-31T17:41:16.564 INFO:teuthology.orchestra.run.smithi095.stdout:ANSI_COLOR="0;31" 2021-05-31T17:41:16.565 INFO:teuthology.orchestra.run.smithi095.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-05-31T17:41:16.565 INFO:teuthology.orchestra.run.smithi095.stdout:HOME_URL="https://www.centos.org/" 2021-05-31T17:41:16.566 INFO:teuthology.orchestra.run.smithi095.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-05-31T17:41:16.567 INFO:teuthology.orchestra.run.smithi095.stdout: 2021-05-31T17:41:16.568 INFO:teuthology.orchestra.run.smithi095.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-05-31T17:41:16.568 INFO:teuthology.orchestra.run.smithi095.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-05-31T17:41:16.568 INFO:teuthology.orchestra.run.smithi095.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-05-31T17:41:16.569 INFO:teuthology.orchestra.run.smithi095.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-05-31T17:41:16.569 INFO:teuthology.orchestra.run.smithi095.stdout: 2021-05-31T17:41:16.571 INFO:teuthology.lock.ops:Updating smithi095.front.sepia.ceph.com on lock server 2021-05-31T17:41:16.676 INFO:teuthology.dispatcher.supervisor:Running job 6143855 2021-05-31T17:41:16.677 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi/6143855 --name yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable} -- /home/teuthworker/archive/yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi/6143855/orig.config.yaml 2021-05-31T17:41:16.680 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi/6143855 2021-05-31T17:41:16.681 INFO:teuthology.dispatcher.supervisor:Job PID: 27339 2021-05-31T17:41:16.681 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-06-01T05:42:02.961 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-06-01T05:42:03.162 INFO:teuthology.kill:Killing Pids: {27339} 2021-06-01T05:42:04.209 INFO:teuthology.kill:Nuking machines: ['smithi019', 'smithi095'] 2021-06-01T05:42:05.190 INFO:teuthology.kill:2021-06-01 05:42:05,190.190 INFO:teuthology.nuke:targets: 2021-06-01T05:42:05.191 INFO:teuthology.kill: smithi019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8fF/NuVBEA1uoxvjxOyDmNrxyTreS6EoMnVO3cyGnbwKx0zA2g7vxyFm17Q4lRq3vPKKaZeNDkasrl9fRaNGrNq/PHUVrNAZ1YNSZrDtMZIhmhBbHGb/xSIAeV0rCo+rZP0wZne6pUgEjNdP3Fe4Vu/LVcXaJnFwqvVhfCug4FJKQoXaKlPZfOu+ysFqi3Dsn+AudnIPz52Mrhbzyx9T+bhwIEHFjQnglm45ezjnTaG/5liS9M02G6qlh/rv5cjO/nqVGRW3ZiFzHSbRwQTfJU8VRNqSSVPF63Ssxz8DgQufa5BRAtKdWZgBtUUjeo6pjH5ORY8Gm2TN6Ef5IHmfWKll+lyrSwxXrn7VSXLza/dZKVBZGOuSN9WjMrJR7JoArIvb7ntHNdPn2MXJDt9O8Cg2DtG80jzP9GcN9yfdaOzOJOT4896Y7xwTQI8rigGnpxXowQIiIbnP9i2CcSrgSuQ/yJNDHewDea0uyNY0A2x6clDgMRiYT8uiJXFObzmE= 2021-06-01T05:42:05.192 INFO:teuthology.kill: smithi095.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWv6mU37xJUfhf+puUKLWFZ5RSuRFNi4S23Lj0Ni+uWP32MNj6/giWSpJApEKCper84SgazcOM6kuDPV6dPNmnkhUAtZVeVORAnPjahooPBADXy3WBwLiIpIq5x+tI3dqNhKZm0IY3JqDSEkw2CHEaZWQuJfbfzx2CYUPYn5D6TXNOUQ9O8VPrJM35cSJF++otS0S9Hkly24L8I5DTPWWe/KuSbOxvpS5gDTIpzMxvX3u9dbflADngQ1QuGGW1OOswhIFNSZNdr1lZtTOMZyYYgzb8BMZM7ZkaS+WPkgRCBkLDK3zEdvL3qFbltGrv7MFsxF+xvxXQXHlRXjSh/uko9cipKExvqK2aQkYeES7+jNEXDrd4JALuYYhnK96EiPz9QXUDdh+EWzi8Aj9lyu2qWs5UOLAdMOzZve2o6TIH47td+byIbbEdK+gewymLdPvjjZEvCkR2NNTkw88HQVJI9OTsiv3EsoSKiAuXsMwg4w6wBiAZD4ivPBWhaVZYyyk= 2021-06-01T05:42:05.192 INFO:teuthology.kill:2021-06-01 05:42:05,191.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T05:42:05.193 INFO:teuthology.kill:2021-06-01 05:42:05,193.193 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T05:42:05.258 INFO:teuthology.kill:2021-06-01 05:42:05,258.258 INFO:teuthology.orchestra.console:Power off smithi019 2021-06-01T05:42:05.274 INFO:teuthology.kill:2021-06-01 05:42:05,274.274 INFO:teuthology.orchestra.console:Power off smithi095 2021-06-01T05:42:13.639 INFO:teuthology.kill:2021-06-01 05:42:13,638.638 INFO:teuthology.orchestra.console:Power off for smithi095 completed 2021-06-01T05:42:17.747 INFO:teuthology.kill:2021-06-01 05:42:17,746.746 INFO:teuthology.orchestra.console:Power off for smithi019 completed 2021-06-01T05:42:18.065 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2021-06-01T05:42:18.066 INFO:teuthology.task.internal:roles: ubuntu@smithi095.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2021-06-01T05:42:18.066 INFO:teuthology.misc:Compressing logs... 2021-06-01T05:42:18.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-01T05:42:52.619 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-06-01T05:42:52.687 INFO:teuthology.kill:No teuthology processes running 2021-06-01T05:42:53.808 INFO:teuthology.kill:Nuking machines: ['smithi019', 'smithi095'] 2021-06-01T05:42:54.754 INFO:teuthology.kill:2021-06-01 05:42:54,754.754 INFO:teuthology.nuke:targets: 2021-06-01T05:42:54.755 INFO:teuthology.kill: smithi019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8fF/NuVBEA1uoxvjxOyDmNrxyTreS6EoMnVO3cyGnbwKx0zA2g7vxyFm17Q4lRq3vPKKaZeNDkasrl9fRaNGrNq/PHUVrNAZ1YNSZrDtMZIhmhBbHGb/xSIAeV0rCo+rZP0wZne6pUgEjNdP3Fe4Vu/LVcXaJnFwqvVhfCug4FJKQoXaKlPZfOu+ysFqi3Dsn+AudnIPz52Mrhbzyx9T+bhwIEHFjQnglm45ezjnTaG/5liS9M02G6qlh/rv5cjO/nqVGRW3ZiFzHSbRwQTfJU8VRNqSSVPF63Ssxz8DgQufa5BRAtKdWZgBtUUjeo6pjH5ORY8Gm2TN6Ef5IHmfWKll+lyrSwxXrn7VSXLza/dZKVBZGOuSN9WjMrJR7JoArIvb7ntHNdPn2MXJDt9O8Cg2DtG80jzP9GcN9yfdaOzOJOT4896Y7xwTQI8rigGnpxXowQIiIbnP9i2CcSrgSuQ/yJNDHewDea0uyNY0A2x6clDgMRiYT8uiJXFObzmE= 2021-06-01T05:42:54.756 INFO:teuthology.kill: smithi095.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWv6mU37xJUfhf+puUKLWFZ5RSuRFNi4S23Lj0Ni+uWP32MNj6/giWSpJApEKCper84SgazcOM6kuDPV6dPNmnkhUAtZVeVORAnPjahooPBADXy3WBwLiIpIq5x+tI3dqNhKZm0IY3JqDSEkw2CHEaZWQuJfbfzx2CYUPYn5D6TXNOUQ9O8VPrJM35cSJF++otS0S9Hkly24L8I5DTPWWe/KuSbOxvpS5gDTIpzMxvX3u9dbflADngQ1QuGGW1OOswhIFNSZNdr1lZtTOMZyYYgzb8BMZM7ZkaS+WPkgRCBkLDK3zEdvL3qFbltGrv7MFsxF+xvxXQXHlRXjSh/uko9cipKExvqK2aQkYeES7+jNEXDrd4JALuYYhnK96EiPz9QXUDdh+EWzi8Aj9lyu2qWs5UOLAdMOzZve2o6TIH47td+byIbbEdK+gewymLdPvjjZEvCkR2NNTkw88HQVJI9OTsiv3EsoSKiAuXsMwg4w6wBiAZD4ivPBWhaVZYyyk= 2021-06-01T05:42:54.775 INFO:teuthology.kill:2021-06-01 05:42:54,774.774 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T05:42:54.778 INFO:teuthology.kill:2021-06-01 05:42:54,777.777 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T05:42:54.825 INFO:teuthology.kill:2021-06-01 05:42:54,825.825 INFO:teuthology.orchestra.console:Power off smithi095 2021-06-01T05:42:54.839 INFO:teuthology.kill:2021-06-01 05:42:54,838.838 INFO:teuthology.orchestra.console:Power off smithi019 2021-06-01T05:42:54.967 INFO:teuthology.kill:2021-06-01 05:42:54,966.966 INFO:teuthology.orchestra.console:Power off for smithi095 completed 2021-06-01T05:42:54.979 INFO:teuthology.kill:2021-06-01 05:42:54,979.979 INFO:teuthology.orchestra.console:Power off for smithi019 completed 2021-06-01T05:42:55.109 INFO:teuthology.kill:2021-06-01 05:42:55,108.108 INFO:teuthology.lock.ops:unlocked smithi095.front.sepia.ceph.com 2021-06-01T05:42:55.123 INFO:teuthology.kill:2021-06-01 05:42:55,123.123 INFO:teuthology.lock.ops:unlocked smithi019.front.sepia.ceph.com 2021-06-01T05:44:55.397 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-06-01T05:44:55.503 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-06-01T05:44:55.503 INFO:teuthology.nuke:Checking targets against current locks 2021-06-01T05:44:55.572 INFO:teuthology.nuke:Not nuking smithi019.front.sepia.ceph.com because description doesn't match 2021-06-01T05:44:55.573 INFO:teuthology.nuke:Not nuking smithi095.front.sepia.ceph.com because description doesn't match