2021-07-10T14:01:55.592 INFO:root:teuthology version: 1.1.0-24e3280d 2021-07-10T14:01:55.593 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_teuthology@teuthology --name teuthology-2021-07-08_06:00:04-rbd-octopus-distro-basic-gibba --description rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/python_api_tests} --archive /home/teuthworker/archive/teuthology-2021-07-08_06:00:04-rbd-octopus-distro-basic-gibba/6258437 -- /home/teuthworker/archive/teuthology-2021-07-08_06:00:04-rbd-octopus-distro-basic-gibba/6258437/orig.config.yaml 2021-07-10T14:01:55.625 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-07-10T14:01:55.673 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-07-08_06:00:04-rbd-octopus-distro-basic-gibba/6258437 branch: octopus description: rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/python_api_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6258437' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: teuthology-2021-07-08_06:00:04-rbd-octopus-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: centos os_version: '8.3' overrides: admin_socket: branch: octopus ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 45c6565d67f116c9b3509842b718398a5b38cf73 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true sha1: 45c6565d67f116c9b3509842b718398a5b38cf73 rbd_fsx: valgrind: - --tool=memcheck selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus env: VALGRIND: --tool=memcheck --leak-check=full sha1: 54bff90266c0649369e90717e0c4df7b0276c9e1 owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: 45c6565d67f116c9b3509842b718398a5b38cf73 sleep_before_teardown: 0 suite: rbd suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_54bff90266c0649369e90717e0c4df7b0276c9e1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 54bff90266c0649369e90717e0c4df7b0276c9e1 targets: gibba004.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJZZMbkHqRCoDbSGqoKi2Q8jQOxJ49ssUH3OGFpLEsosmWQldnxaGU70/Cr2jTLpwqWzMVIvXAiI3X1tMs88T0gHcXy65ubzhyjYW0ZbAgchKFZZGMSOkmJCJd6/Ea9NmChDeN4eD9D89mC0nHUef0eUlAuTz5h44Q9RCoPc0GgFj/jMQR4Ws1FvGwdHZmLUeATT9EdcZRfbwLqR/ec7bNLR2AxrPFjdQwjce4kbt6I12i+FxTZXGMubdTJ8kW5rYkNbCTM6lal+Iq3ucxL1la1A9/qr+DNAwsheZabLPKLneF/ddzxQTow6GkdRcaSGI/IO++BeIJfnMLDqmARRJn7wQ47d5gijq3WxQfm4EdAys9VmtnGlk804ZnhwdHCE1seAOWORSmo5/jPlUBzanw2odNGHsOTRCt8/Detg5oQgMGQGKtAMjbYui9U9NvkarOEhbPX2w/313kMZecQwha9BSBvjVUPzCz8i0z72sf6ulwDi1nG/0pXuzltMspp98= tasks: - install: null - ceph: null - workunit: clients: client.0: - rbd/test_librbd_python.sh env: RBD_FEATURES: '1' teuthology_branch: master teuthology_sha1: 24e3280d7d1fc156628af95b24b27a29e38b2766 timestamp: 2021-07-08_06:00:04 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.8273 2021-07-10T14:01:55.673 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_54bff90266c0649369e90717e0c4df7b0276c9e1/qa; will attempt to use it 2021-07-10T14:01:55.674 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_54bff90266c0649369e90717e0c4df7b0276c9e1/qa/tasks 2021-07-10T14:01:55.674 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-07-10T14:01:55.676 INFO:teuthology.task.internal:Checking packages... 2021-07-10T14:01:55.695 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '45c6565d67f116c9b3509842b718398a5b38cf73' 2021-07-10T14:01:55.695 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-10T14:01:55.696 INFO:teuthology.packaging:ref: None 2021-07-10T14:01:55.696 INFO:teuthology.packaging:tag: None 2021-07-10T14:01:55.696 INFO:teuthology.packaging:branch: octopus 2021-07-10T14:01:55.697 INFO:teuthology.packaging:sha1: 45c6565d67f116c9b3509842b718398a5b38cf73 2021-07-10T14:01:55.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2021-07-10T14:01:55.937 INFO:teuthology.task.internal:Found packages for ceph version 15.2.13-132.g54bff902 2021-07-10T14:01:55.938 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-07-10T14:01:55.949 INFO:teuthology.task.internal:no buildpackages task found 2021-07-10T14:01:55.949 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-07-10T14:01:55.987 INFO:teuthology.task.internal:Saving configuration 2021-07-10T14:01:55.999 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-07-10T14:01:56.021 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-10T14:01:56.037 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-10 13:57:22.388550', 'description': '/home/teuthworker/archive/teuthology-2021-07-08_06:00:04-rbd-octopus-distro-basic-gibba/6258437', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjOCY0COe1Dqx72c8PrmVbr1LUOy8Y35Px2K4RkmxSCxvg8uiBeX318cI0Es3ZZ+GZAMSV+JoMdnlgTBS02aro=', 'os_version': '8', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba004.front.sepia.ceph.com'} 2021-07-10T14:01:56.037 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-07-10T14:01:56.051 INFO:teuthology.task.internal:roles: ubuntu@gibba004.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2021-07-10T14:01:56.051 INFO:teuthology.run_tasks:Running task console_log... 2021-07-10T14:01:56.101 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faaf57b2ae8>, signals=[15]) 2021-07-10T14:01:56.102 INFO:teuthology.run_tasks:Running task internal.connect... 2021-07-10T14:01:56.115 INFO:teuthology.task.internal:Opening connections... 2021-07-10T14:01:56.116 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:01:56.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:01:56.185 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-07-10T14:01:56.197 DEBUG:teuthology.orchestra.run.gibba004:> uname -m 2021-07-10T14:01:56.263 INFO:teuthology.orchestra.run.gibba004.stdout:x86_64 2021-07-10T14:01:56.263 DEBUG:teuthology.orchestra.run.gibba004:> cat /etc/os-release 2021-07-10T14:01:56.315 INFO:teuthology.orchestra.run.gibba004.stdout:NAME="CentOS Linux" 2021-07-10T14:01:56.315 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION="8" 2021-07-10T14:01:56.315 INFO:teuthology.orchestra.run.gibba004.stdout:ID="centos" 2021-07-10T14:01:56.316 INFO:teuthology.orchestra.run.gibba004.stdout:ID_LIKE="rhel fedora" 2021-07-10T14:01:56.316 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION_ID="8" 2021-07-10T14:01:56.316 INFO:teuthology.orchestra.run.gibba004.stdout:PLATFORM_ID="platform:el8" 2021-07-10T14:01:56.316 INFO:teuthology.orchestra.run.gibba004.stdout:PRETTY_NAME="CentOS Linux 8" 2021-07-10T14:01:56.316 INFO:teuthology.orchestra.run.gibba004.stdout:ANSI_COLOR="0;31" 2021-07-10T14:01:56.317 INFO:teuthology.orchestra.run.gibba004.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-10T14:01:56.317 INFO:teuthology.orchestra.run.gibba004.stdout:HOME_URL="https://centos.org/" 2021-07-10T14:01:56.317 INFO:teuthology.orchestra.run.gibba004.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-07-10T14:01:56.317 INFO:teuthology.orchestra.run.gibba004.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-07-10T14:01:56.317 INFO:teuthology.orchestra.run.gibba004.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-07-10T14:01:56.318 INFO:teuthology.lock.ops:Updating gibba004.front.sepia.ceph.com on lock server 2021-07-10T14:01:56.333 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-07-10T14:01:56.346 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-07-10T14:01:56.370 INFO:teuthology.task.internal:Checking for old test directory... 2021-07-10T14:01:56.371 DEBUG:teuthology.orchestra.run.gibba004:> test '!' -e /home/ubuntu/cephtest 2021-07-10T14:01:56.382 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-07-10T14:01:56.407 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-07-10T14:01:56.407 DEBUG:teuthology.orchestra.run.gibba004:> test -z $(ls -A /var/lib/ceph) 2021-07-10T14:01:56.455 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-07-10T14:01:56.483 INFO:teuthology.run_tasks:Running task kernel... 2021-07-10T14:01:56.502 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2021-07-10T14:01:56.503 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-07-10T14:01:56.503 DEBUG:teuthology.orchestra.run.gibba004:> uname -r 2021-07-10T14:01:56.515 INFO:teuthology.orchestra.run.gibba004.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-07-10T14:01:56.515 INFO:teuthology.task.kernel:Running kernel on gibba004: 4.18.0-240.10.1.el8_3.x86_64 2021-07-10T14:01:56.515 DEBUG:teuthology.orchestra.run.gibba004:> sudo yum install -y kernel 2021-07-10T14:01:59.210 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - AppStream 29 MB/s | 8.1 MB 00:00 2021-07-10T14:02:00.322 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - Base 20 MB/s | 3.6 MB 00:00 2021-07-10T14:02:00.793 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - Extras 119 kB/s | 9.8 kB 00:00 2021-07-10T14:02:02.495 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS Linux 8 - AppStream 4.9 MB/s | 8.1 MB 00:01 2021-07-10T14:02:04.018 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS Linux 8 - BaseOS 5.9 MB/s | 3.6 MB 00:00 2021-07-10T14:02:04.696 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS Linux 8 - Extras 34 kB/s | 9.8 kB 00:00 2021-07-10T14:02:05.492 INFO:teuthology.orchestra.run.gibba004.stdout:Extra Packages for Enterprise Linux 13 MB/s | 10 MB 00:00 2021-07-10T14:02:07.036 INFO:teuthology.orchestra.run.gibba004.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2021-07-10T14:02:08.385 INFO:teuthology.orchestra.run.gibba004.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-07-10T14:02:08.385 INFO:teuthology.orchestra.run.gibba004.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-07-10T14:02:08.628 INFO:teuthology.orchestra.run.gibba004.stdout:Dependencies resolved. 2021-07-10T14:02:08.653 INFO:teuthology.orchestra.run.gibba004.stdout:================================================================================ 2021-07-10T14:02:08.654 INFO:teuthology.orchestra.run.gibba004.stdout: Package Arch Version Repository Size 2021-07-10T14:02:08.654 INFO:teuthology.orchestra.run.gibba004.stdout:================================================================================ 2021-07-10T14:02:08.654 INFO:teuthology.orchestra.run.gibba004.stdout:Installing: 2021-07-10T14:02:08.655 INFO:teuthology.orchestra.run.gibba004.stdout: kernel x86_64 4.18.0-305.7.1.el8_4 CentOS-Base 5.9 M 2021-07-10T14:02:08.655 INFO:teuthology.orchestra.run.gibba004.stdout:Installing dependencies: 2021-07-10T14:02:08.655 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-core x86_64 4.18.0-305.7.1.el8_4 CentOS-Base 36 M 2021-07-10T14:02:08.655 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-modules x86_64 4.18.0-305.7.1.el8_4 CentOS-Base 28 M 2021-07-10T14:02:08.655 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-07-10T14:02:08.656 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction Summary 2021-07-10T14:02:08.656 INFO:teuthology.orchestra.run.gibba004.stdout:================================================================================ 2021-07-10T14:02:08.656 INFO:teuthology.orchestra.run.gibba004.stdout:Install 3 Packages 2021-07-10T14:02:08.656 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-07-10T14:02:08.656 INFO:teuthology.orchestra.run.gibba004.stdout:Total download size: 70 M 2021-07-10T14:02:08.657 INFO:teuthology.orchestra.run.gibba004.stdout:Installed size: 88 M 2021-07-10T14:02:08.657 INFO:teuthology.orchestra.run.gibba004.stdout:Downloading Packages: 2021-07-10T14:02:10.071 INFO:teuthology.orchestra.run.gibba004.stdout:(1/3): kernel-4.18.0-305.7.1.el8_4.x86_64.rpm 4.2 MB/s | 5.9 MB 00:01 2021-07-10T14:02:11.300 INFO:teuthology.orchestra.run.gibba004.stdout:(2/3): kernel-modules-4.18.0-305.7.1.el8_4.x86_ 11 MB/s | 28 MB 00:02 2021-07-10T14:02:12.401 INFO:teuthology.orchestra.run.gibba004.stdout:(3/3): kernel-core-4.18.0-305.7.1.el8_4.x86_64. 9.6 MB/s | 36 MB 00:03 2021-07-10T14:02:12.404 INFO:teuthology.orchestra.run.gibba004.stdout:-------------------------------------------------------------------------------- 2021-07-10T14:02:12.404 INFO:teuthology.orchestra.run.gibba004.stdout:Total 19 MB/s | 70 MB 00:03 2021-07-10T14:02:12.487 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction check 2021-07-10T14:02:12.760 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction check succeeded. 2021-07-10T14:02:12.761 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction test 2021-07-10T14:02:13.836 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction test succeeded. 2021-07-10T14:02:13.854 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction 2021-07-10T14:02:15.721 INFO:teuthology.orchestra.run.gibba004.stdout: Preparing : 1/1 2021-07-10T14:02:16.180 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : kernel-core-4.18.0-305.7.1.el8_4.x86_64 1/3 2021-07-10T14:02:18.661 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: kernel-core-4.18.0-305.7.1.el8_4.x86_64 1/3 2021-07-10T14:02:19.055 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : kernel-modules-4.18.0-305.7.1.el8_4.x86_64 2/3 2021-07-10T14:02:21.412 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: kernel-modules-4.18.0-305.7.1.el8_4.x86_64 2/3 2021-07-10T14:02:21.588 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : kernel-4.18.0-305.7.1.el8_4.x86_64 3/3 2021-07-10T14:02:36.615 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: kernel-core-4.18.0-305.7.1.el8_4.x86_64 3/3 2021-07-10T14:02:36.828 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: kernel-4.18.0-305.7.1.el8_4.x86_64 3/3 2021-07-10T14:02:36.829 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : kernel-4.18.0-305.7.1.el8_4.x86_64 1/3 2021-07-10T14:02:36.829 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : kernel-core-4.18.0-305.7.1.el8_4.x86_64 2/3 2021-07-10T14:02:37.331 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : kernel-modules-4.18.0-305.7.1.el8_4.x86_64 3/3 2021-07-10T14:02:37.331 INFO:teuthology.orchestra.run.gibba004.stdout:Installed products updated. 2021-07-10T14:02:37.352 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-07-10T14:02:37.353 INFO:teuthology.orchestra.run.gibba004.stdout:Installed: 2021-07-10T14:02:37.353 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:37.353 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-core-4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:37.353 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-modules-4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:37.353 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-07-10T14:02:37.354 INFO:teuthology.orchestra.run.gibba004.stdout:Complete! 2021-07-10T14:02:37.400 DEBUG:teuthology.orchestra.run.gibba004:> rpm -q kernel --last | head -n 1 2021-07-10T14:02:37.498 INFO:teuthology.orchestra.run.gibba004.stdout:kernel-4.18.0-305.7.1.el8_4.x86_64 Sat 10 Jul 2021 02:02:21 PM UTC 2021-07-10T14:02:37.499 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:37.500 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:37.500 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-07-10T14:02:37.500 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-10T14:02:37.501 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-07-10T14:02:37.501 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba004.front.sepia.ceph.com, path=None, version=distro) 2021-07-10T14:02:37.501 DEBUG:teuthology.orchestra.run.gibba004:> rpm -q kernel --last | head -n 1 2021-07-10T14:02:37.590 INFO:teuthology.orchestra.run.gibba004.stdout:kernel-4.18.0-305.7.1.el8_4.x86_64 Sat 10 Jul 2021 02:02:21 PM UTC 2021-07-10T14:02:37.591 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:37.592 DEBUG:teuthology.orchestra.run.gibba004:> sudo rpm -qi grub2-tools 2021-07-10T14:02:37.615 INFO:teuthology.orchestra.run.gibba004.stdout:Name : grub2-tools 2021-07-10T14:02:37.616 INFO:teuthology.orchestra.run.gibba004.stdout:Epoch : 1 2021-07-10T14:02:37.616 INFO:teuthology.orchestra.run.gibba004.stdout:Version : 2.02 2021-07-10T14:02:37.616 INFO:teuthology.orchestra.run.gibba004.stdout:Release : 90.el8 2021-07-10T14:02:37.616 INFO:teuthology.orchestra.run.gibba004.stdout:Architecture: x86_64 2021-07-10T14:02:37.617 INFO:teuthology.orchestra.run.gibba004.stdout:Install Date: Mon 01 Mar 2021 06:17:39 PM UTC 2021-07-10T14:02:37.617 INFO:teuthology.orchestra.run.gibba004.stdout:Group : System Environment/Base 2021-07-10T14:02:37.617 INFO:teuthology.orchestra.run.gibba004.stdout:Size : 9197207 2021-07-10T14:02:37.617 INFO:teuthology.orchestra.run.gibba004.stdout:License : GPLv3+ 2021-07-10T14:02:37.617 INFO:teuthology.orchestra.run.gibba004.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-07-10T14:02:37.618 INFO:teuthology.orchestra.run.gibba004.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-07-10T14:02:37.618 INFO:teuthology.orchestra.run.gibba004.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-07-10T14:02:37.618 INFO:teuthology.orchestra.run.gibba004.stdout:Build Host : kbuilder.bsys.centos.org 2021-07-10T14:02:37.618 INFO:teuthology.orchestra.run.gibba004.stdout:Relocations : (not relocatable) 2021-07-10T14:02:37.619 INFO:teuthology.orchestra.run.gibba004.stdout:Packager : CentOS BuildSystem 2021-07-10T14:02:37.619 INFO:teuthology.orchestra.run.gibba004.stdout:Vendor : CentOS 2021-07-10T14:02:37.619 INFO:teuthology.orchestra.run.gibba004.stdout:URL : http://www.gnu.org/software/grub/ 2021-07-10T14:02:37.619 INFO:teuthology.orchestra.run.gibba004.stdout:Summary : Support tools for GRUB. 2021-07-10T14:02:37.619 INFO:teuthology.orchestra.run.gibba004.stdout:Description : 2021-07-10T14:02:37.620 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-07-10T14:02:37.620 INFO:teuthology.orchestra.run.gibba004.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-07-10T14:02:37.620 INFO:teuthology.orchestra.run.gibba004.stdout:customizable bootloader with modular architecture. It supports a rich 2021-07-10T14:02:37.620 INFO:teuthology.orchestra.run.gibba004.stdout:variety of kernel formats, file systems, computer architectures and 2021-07-10T14:02:37.621 INFO:teuthology.orchestra.run.gibba004.stdout:hardware devices. 2021-07-10T14:02:37.621 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-07-10T14:02:37.621 INFO:teuthology.orchestra.run.gibba004.stdout:This subpackage provides tools for support of all platforms. 2021-07-10T14:02:37.622 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-07-10T14:02:37.622 INFO:teuthology.task.kernel:Updating grub on gibba004 to boot 4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:37.623 DEBUG:teuthology.orchestra.run.gibba004:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-07-10T14:02:39.431 INFO:teuthology.orchestra.run.gibba004.stderr:Generating grub configuration file ... 2021-07-10T14:02:41.415 INFO:teuthology.orchestra.run.gibba004.stderr:done 2021-07-10T14:02:41.416 DEBUG:teuthology.orchestra.run.gibba004:> mktemp 2021-07-10T14:02:41.458 INFO:teuthology.orchestra.run.gibba004.stdout:/tmp/tmp.9TuKqEpgSU 2021-07-10T14:02:41.459 DEBUG:teuthology.orchestra.run.gibba004:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9TuKqEpgSU 2021-07-10T14:02:41.519 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod 0666 /tmp/tmp.9TuKqEpgSU 2021-07-10T14:02:41.647 DEBUG:teuthology.orchestra.remote:gibba004:/tmp/tmp.9TuKqEpgSU is 6KB 2021-07-10T14:02:41.663 DEBUG:teuthology.orchestra.run.gibba004:> rm -fr /tmp/tmp.9TuKqEpgSU 2021-07-10T14:02:41.673 DEBUG:teuthology.orchestra.run.gibba004:> sudo /bin/ls /boot/loader/entries || true 2021-07-10T14:02:41.731 INFO:teuthology.orchestra.run.gibba004.stdout:92adf42ad41c494ca60776c555ce9106-0-rescue.conf 2021-07-10T14:02:41.731 INFO:teuthology.orchestra.run.gibba004.stdout:92adf42ad41c494ca60776c555ce9106-4.18.0-240.10.1.el8_3.x86_64.conf 2021-07-10T14:02:41.731 INFO:teuthology.orchestra.run.gibba004.stdout:92adf42ad41c494ca60776c555ce9106-4.18.0-240.el8.x86_64.conf 2021-07-10T14:02:41.731 INFO:teuthology.orchestra.run.gibba004.stdout:92adf42ad41c494ca60776c555ce9106-4.18.0-305.7.1.el8_4.x86_64.conf 2021-07-10T14:02:41.732 DEBUG:teuthology.orchestra.run.gibba004:> sudo grub2-set-default 92adf42ad41c494ca60776c555ce9106-4.18.0-305.7.1.el8_4.x86_64 2021-07-10T14:02:41.858 DEBUG:teuthology.orchestra.run.gibba004:> sudo shutdown -r now 2021-07-10T14:03:11.890 INFO:teuthology.misc:Re-opening connections... 2021-07-10T14:03:11.891 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:03:11.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:03:11.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:03:30.379 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:03:30.380 DEBUG:teuthology.misc:waited 18.4886691570282 2021-07-10T14:03:31.381 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:03:31.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:03:31.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:03:34.443 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:03:34.443 DEBUG:teuthology.misc:waited 22.55205273628235 2021-07-10T14:03:35.445 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:03:35.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:03:35.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:03:37.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:03:37.520 DEBUG:teuthology.misc:waited 25.628625631332397 2021-07-10T14:03:38.521 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:03:38.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:03:38.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:03:40.587 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:03:40.587 DEBUG:teuthology.misc:waited 28.69600224494934 2021-07-10T14:03:41.589 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:03:41.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:03:41.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:03:43.659 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:03:43.659 DEBUG:teuthology.misc:waited 31.767938137054443 2021-07-10T14:03:44.661 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:03:44.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:03:44.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:03:46.731 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:03:46.732 DEBUG:teuthology.misc:waited 34.840649127960205 2021-07-10T14:03:47.733 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:03:47.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:03:47.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:04:47.796 DEBUG:teuthology.orchestra.remote:timed out 2021-07-10T14:04:47.798 DEBUG:teuthology.misc:waited 95.90670442581177 2021-07-10T14:04:48.800 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:04:48.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:04:48.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:04:51.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:04:51.883 DEBUG:teuthology.misc:waited 99.99196290969849 2021-07-10T14:04:52.885 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:04:52.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:04:52.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:04:54.955 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:04:54.955 DEBUG:teuthology.misc:waited 103.0641074180603 2021-07-10T14:04:55.957 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:04:55.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:04:55.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:04:58.027 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:04:58.027 DEBUG:teuthology.misc:waited 106.1359133720398 2021-07-10T14:04:59.029 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:04:59.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:04:59.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:01.099 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:01.099 DEBUG:teuthology.misc:waited 109.20798134803772 2021-07-10T14:05:02.101 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:02.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:02.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:04.171 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:04.171 DEBUG:teuthology.misc:waited 112.28015685081482 2021-07-10T14:05:05.173 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:05.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:05.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:07.243 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:07.244 DEBUG:teuthology.misc:waited 115.35251235961914 2021-07-10T14:05:08.246 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:08.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:08.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:10.315 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:10.315 DEBUG:teuthology.misc:waited 118.42403888702393 2021-07-10T14:05:11.317 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:11.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:11.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:13.387 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:13.387 DEBUG:teuthology.misc:waited 121.49616622924805 2021-07-10T14:05:14.389 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:14.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:14.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:16.459 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:16.459 DEBUG:teuthology.misc:waited 124.56805872917175 2021-07-10T14:05:17.461 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:17.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:17.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:19.531 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:19.531 DEBUG:teuthology.misc:waited 127.63993096351624 2021-07-10T14:05:20.533 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:20.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:20.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:22.603 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:22.603 DEBUG:teuthology.misc:waited 130.71218419075012 2021-07-10T14:05:23.605 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:23.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:23.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:25.675 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:25.675 DEBUG:teuthology.misc:waited 133.78410005569458 2021-07-10T14:05:26.677 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:26.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:26.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:28.747 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:28.747 DEBUG:teuthology.misc:waited 136.85604238510132 2021-07-10T14:05:29.748 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:29.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:29.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:31.819 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:31.819 DEBUG:teuthology.misc:waited 139.9279420375824 2021-07-10T14:05:32.821 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:32.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:32.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:34.891 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:34.891 DEBUG:teuthology.misc:waited 143.00003933906555 2021-07-10T14:05:35.893 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:35.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:35.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:37.963 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:37.963 DEBUG:teuthology.misc:waited 146.0720088481903 2021-07-10T14:05:38.964 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:38.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:38.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:41.035 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:41.036 DEBUG:teuthology.misc:waited 149.14475965499878 2021-07-10T14:05:42.037 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:42.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:42.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:44.107 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:44.107 DEBUG:teuthology.misc:waited 152.21604871749878 2021-07-10T14:05:45.109 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:45.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:45.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:47.179 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:47.179 DEBUG:teuthology.misc:waited 155.28791761398315 2021-07-10T14:05:48.181 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:48.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:48.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:50.251 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:50.251 DEBUG:teuthology.misc:waited 158.3599557876587 2021-07-10T14:05:51.253 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:51.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:51.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:53.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:53.323 DEBUG:teuthology.misc:waited 161.43187975883484 2021-07-10T14:05:54.325 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:54.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:54.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:56.395 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:56.395 DEBUG:teuthology.misc:waited 164.5040557384491 2021-07-10T14:05:57.397 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:05:57.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:05:57.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:05:59.467 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:05:59.467 DEBUG:teuthology.misc:waited 167.57606744766235 2021-07-10T14:06:00.469 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:00.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:00.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:02.539 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:02.539 DEBUG:teuthology.misc:waited 170.6479094028473 2021-07-10T14:06:03.541 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:03.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:03.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:05.611 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:05.611 DEBUG:teuthology.misc:waited 173.71997618675232 2021-07-10T14:06:06.613 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:06.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:06.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:08.683 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:08.683 DEBUG:teuthology.misc:waited 176.79199314117432 2021-07-10T14:06:09.685 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:09.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:09.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:11.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:11.759 DEBUG:teuthology.misc:waited 179.86797070503235 2021-07-10T14:06:12.761 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:12.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:12.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:14.831 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:14.832 DEBUG:teuthology.misc:waited 182.94048833847046 2021-07-10T14:06:15.833 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:15.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:15.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:17.899 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:17.899 DEBUG:teuthology.misc:waited 186.00787019729614 2021-07-10T14:06:18.901 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:18.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:18.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:20.971 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:20.971 DEBUG:teuthology.misc:waited 189.07994723320007 2021-07-10T14:06:21.973 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:21.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:21.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:24.043 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:24.043 DEBUG:teuthology.misc:waited 192.15186643600464 2021-07-10T14:06:25.045 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:25.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:25.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:27.115 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:27.115 DEBUG:teuthology.misc:waited 195.22400498390198 2021-07-10T14:06:28.117 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:28.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:28.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:30.187 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:30.187 DEBUG:teuthology.misc:waited 198.29596972465515 2021-07-10T14:06:31.189 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:31.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:31.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:33.259 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:33.259 DEBUG:teuthology.misc:waited 201.36800456047058 2021-07-10T14:06:34.260 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:34.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:34.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:36.331 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:36.331 DEBUG:teuthology.misc:waited 204.43991541862488 2021-07-10T14:06:37.333 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:37.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:37.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:39.403 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:39.404 DEBUG:teuthology.misc:waited 207.51277351379395 2021-07-10T14:06:40.405 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:40.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:40.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:42.475 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:42.475 DEBUG:teuthology.misc:waited 210.58400177955627 2021-07-10T14:06:43.477 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:43.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:43.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:45.547 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:45.547 DEBUG:teuthology.misc:waited 213.65608096122742 2021-07-10T14:06:46.549 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:46.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:46.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:48.619 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:48.619 DEBUG:teuthology.misc:waited 216.72800612449646 2021-07-10T14:06:49.621 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:49.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:49.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:51.691 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:51.691 DEBUG:teuthology.misc:waited 219.79992747306824 2021-07-10T14:06:52.693 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:52.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:52.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:54.763 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:54.763 DEBUG:teuthology.misc:waited 222.87210536003113 2021-07-10T14:06:55.765 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:55.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:55.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:06:57.835 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:06:57.835 DEBUG:teuthology.misc:waited 225.94408512115479 2021-07-10T14:06:58.837 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:06:58.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:06:58.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:00.907 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:00.907 DEBUG:teuthology.misc:waited 229.01598501205444 2021-07-10T14:07:01.909 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:01.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:01.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:03.979 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:03.979 DEBUG:teuthology.misc:waited 232.08811020851135 2021-07-10T14:07:04.981 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:04.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:04.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:07.051 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:07.051 DEBUG:teuthology.misc:waited 235.15996766090393 2021-07-10T14:07:08.053 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:08.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:08.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:10.123 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:10.123 DEBUG:teuthology.misc:waited 238.231942653656 2021-07-10T14:07:11.125 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:11.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:11.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:13.195 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:13.195 DEBUG:teuthology.misc:waited 241.30394387245178 2021-07-10T14:07:14.197 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:14.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:14.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:16.267 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:16.267 DEBUG:teuthology.misc:waited 244.37606287002563 2021-07-10T14:07:17.268 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:17.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:17.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:19.342 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:19.342 DEBUG:teuthology.misc:waited 247.45115184783936 2021-07-10T14:07:20.344 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:20.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:20.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:22.411 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:22.411 DEBUG:teuthology.misc:waited 250.52000498771667 2021-07-10T14:07:23.413 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:23.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:23.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:25.483 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:25.483 DEBUG:teuthology.misc:waited 253.59189224243164 2021-07-10T14:07:26.484 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:26.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:26.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:28.555 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:28.556 DEBUG:teuthology.misc:waited 256.6642668247223 2021-07-10T14:07:29.557 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:29.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:29.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:31.627 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:31.627 DEBUG:teuthology.misc:waited 259.735995054245 2021-07-10T14:07:32.629 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:32.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:32.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:34.699 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:34.699 DEBUG:teuthology.misc:waited 262.8081376552582 2021-07-10T14:07:35.701 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:35.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:35.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:37.771 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:37.772 DEBUG:teuthology.misc:waited 265.88063621520996 2021-07-10T14:07:38.773 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:38.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:38.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:40.843 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:40.843 DEBUG:teuthology.misc:waited 268.9518463611603 2021-07-10T14:07:41.844 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:41.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:41.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:43.915 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:43.915 DEBUG:teuthology.misc:waited 272.02410101890564 2021-07-10T14:07:44.917 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:44.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:44.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:46.987 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:46.987 DEBUG:teuthology.misc:waited 275.0959703922272 2021-07-10T14:07:47.989 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:47.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:47.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:50.059 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:50.059 DEBUG:teuthology.misc:waited 278.16791343688965 2021-07-10T14:07:51.061 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:51.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:51.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:53.132 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:53.133 DEBUG:teuthology.misc:waited 281.24193263053894 2021-07-10T14:07:54.134 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:54.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:54.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:56.203 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:56.203 DEBUG:teuthology.misc:waited 284.31197237968445 2021-07-10T14:07:57.205 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:07:57.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:07:57.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:07:59.275 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:07:59.275 DEBUG:teuthology.misc:waited 287.38393330574036 2021-07-10T14:08:00.277 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:08:00.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:08:00.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:08:02.347 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:08:02.347 DEBUG:teuthology.misc:waited 290.4559168815613 2021-07-10T14:08:03.349 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:08:03.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:08:03.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:08:05.419 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:08:05.419 DEBUG:teuthology.misc:waited 293.52800488471985 2021-07-10T14:08:06.421 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:08:06.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:08:06.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:08:08.491 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:08:08.491 DEBUG:teuthology.misc:waited 296.5999481678009 2021-07-10T14:08:09.493 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:08:09.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:08:09.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:08:11.563 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:08:11.563 DEBUG:teuthology.misc:waited 299.67191791534424 2021-07-10T14:08:12.565 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:08:12.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-10T14:08:12.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-10T14:08:14.635 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-07-10T14:08:14.635 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/task/kernel.py", line 1340, in task wait_for_reboot(ctx, need_version, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/task/kernel.py", line 695, in wait_for_reboot teuthology.reconnect(ctx, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/misc.py", line 934, in reconnect remote.name) RuntimeError: Could not reconnect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:08:14.720 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6418b0c7a29742d5adac440c6d83916a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/task/kernel.py", line 1340, in task wait_for_reboot(ctx, need_version, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/task/kernel.py", line 695, in wait_for_reboot teuthology.reconnect(ctx, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/misc.py", line 934, in reconnect remote.name) RuntimeError: Could not reconnect to ubuntu@gibba004.front.sepia.ceph.com 2021-07-10T14:08:14.722 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-07-10T14:08:14.779 INFO:teuthology.nuke:Checking targets against current locks 2021-07-10T14:08:14.900 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/run.py", line 414, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/run.py", line 271, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_24e3280d7d1fc156628af95b24b27a29e38b2766/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable