2021-11-21T05:47:20.219 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-21T05:47:20.221 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/libcephfs_interface_tests}} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888 --verbose -- /home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888/orig.config.yaml 2021-11-21T05:47:20.261 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-21T05:47:20.344 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888 branch: master description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/libcephfs_interface_tests}} email: ceph-qa@ceph.io first_in_suite: false job_id: '6517888' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: gibba name: teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba nuke-on-error: true openstack: - volumes: count: 2 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 10 os_type: centos os_version: '8.3' overrides: admin_socket: branch: master ceph: conf: client: debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 0f9ed11e6727bf4fccef4a0481cd9391f27d3cff ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0f9ed11e6727bf4fccef4a0481cd9391f27d3cff selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: master sha1: 0f9ed11e6727bf4fccef4a0481cd9391f27d3cff owner: scheduled_teuthology@teuthology priority: 70 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mds.a - mgr.x - osd.0 - osd.1 - - mon.b - mds.b - mon.c - mgr.y - osd.2 - osd.3 - - client.0 sha1: 0f9ed11e6727bf4fccef4a0481cd9391f27d3cff sleep_before_teardown: 0 suite: smoke suite_branch: master suite_path: /home/teuthworker/src/github.com_ceph_ceph_0f9ed11e6727bf4fccef4a0481cd9391f27d3cff/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 0f9ed11e6727bf4fccef4a0481cd9391f27d3cff targets: gibba001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpiqUwYkjm3oihYDh4sza4URXUPea6Hk622oNxbe6F6xgLcLVRr7uBS4xQQ/1EwkYqI9bV+cTrH9FNk+beHC1Z6OWseGWcnyJzGEPyXhY8UlG2LvSfaK0LLy2G3A7Dq7++nT20ZV3ZLiTJX2Gz9er0oTTcWxZixAQGP9e1KTAapCHumCNiOQ3haliKjL+P1gtk2MvjrFqNLAb8pstjV7+G3IVu06K7cNX/RqvTEaJ7eyYd7/KqJJ16nvJ2KSbsltgAdFXTh0c5k4fPCrvDeAaw1+oy6lpyywdEuaAgcVqD+zpuYH/hzBNdlTerx92W68D7lnyxDUUT5xibnSd47Kr6qG9eznr/1oR+1Nd0EcowvRT+zUfZQ8ZfzCd7BKcOBXM+ttnqTZCgToUkQbu0FoDyRutmbmITpfanCEFoWQoFWPE6JvkD4UNu3TWZ5aMq/MXLS0AsxwmXSBHCs4asaqy+u9UIzqRHFMPlMFvS0Vh5TjWmaDpXbwUeMzhEzVtMbks= gibba031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfcw4ikHXA0++lklaD+IGGwQiU2MP+nnc7h/fuJC+MKOO0fqi12FjT4qrbPc52eKcw3C3NwhQC/eHpBJF1ZWJCmo6dducU9emWCpum2Sf8HFCMWI98v9JdviKz+BlBdnQY9OyLeL7ICFIXBMDwgawyBkCe5j+LhgXPPXdLX52pFJAOuKLoiY7jtd36yVbhdTF1PT9SZDREzx2RxFvW8hYDHvXjDFnSsmOHykaZfigjU1PN8iI4pEG1GZ6MJMT2WOFfT8XLMpFpbFwO46DCOyeMaS0mSA1e3JG9cBBIyqQ+HS+O+Ytb8n4xkojSShQaEotjqeqqcNG+WxQFq70n+pYD2kvBBuaMYYJmiiDffGSLqn4CqPbvmHqtoylserwgXK3z2n63nqYKo/UGJd5izllVcTKdcjiLyeKoseblBW2O4TcYeyIopvlnIWzOrTSn1eFjMYmWwR0oILwcXi6IVAUZgX1VZDktRB14nG9k1BJYuKB6F4JRWr4DA/lnpPCfau8= gibba038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyN0Tvk+NjO9vIHuyyMmWF6i3DpO9jAsJoTGzx1p/hzrYb0QXH4UK6Il7BWrXetcyB5f4NrpH8QY8wH+S+4UzUZuWLmlYP7Wsynu0Usex1phqBQosRFRyuMFRXl0ef5I3gaVLqPfLgjUlauJnzkcA8IDB4X8mhY3UxlAztBoopFyN4zOFDgXi5LARm82A2ocbuSHELnkCZ+IDC3E+AMTR216/YBDdA5asuL6bIuhFrOUgBaGdK1iczDtiadiT73xZTQ5L9UxV5mvXsWjuY2ga5/4vpD53R6kKaMhBUTaQ3wDzERg7n3+RjR8qLHSRTNnOGdrQQtTYhJnUZrErUXHOPuNTDqvT8T+U/hgbdQsHDr3f1NWnJr2RDPkxYbdapvNz7A5MF0QQNygWC/xRTmNOvwPTJGLQvD+dWAQrGdtM73SbIRzrdcbzfP/S+CBC2zraa43/dStSA3L46o1VvJGHNlcFL4miJx9JjViPCmlvyByl0exUtht1oQCT7fvWH5gE= tasks: - install: cleanup: true - ceph: null - ceph-fuse: null - workunit: clients: client.0: - libcephfs/test.sh teuthology_branch: master teuthology_sha1: 6cfddd5e1c7d5ede1367cf3087c21af44eb88356 timestamp: 2021-11-21_05:00:03 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.19943 2021-11-21T05:47:20.345 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_0f9ed11e6727bf4fccef4a0481cd9391f27d3cff/qa; will attempt to use it 2021-11-21T05:47:20.348 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_0f9ed11e6727bf4fccef4a0481cd9391f27d3cff/qa/tasks 2021-11-21T05:47:20.349 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-11-21T05:47:20.351 INFO:teuthology.task.internal:Checking packages... 2021-11-21T05:47:20.374 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0f9ed11e6727bf4fccef4a0481cd9391f27d3cff' 2021-11-21T05:47:20.375 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-11-21T05:47:20.375 INFO:teuthology.packaging:ref: None 2021-11-21T05:47:20.376 INFO:teuthology.packaging:tag: None 2021-11-21T05:47:20.376 INFO:teuthology.packaging:branch: master 2021-11-21T05:47:20.377 INFO:teuthology.packaging:sha1: 0f9ed11e6727bf4fccef4a0481cd9391f27d3cff 2021-11-21T05:47:20.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=master 2021-11-21T05:47:20.712 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-9149.g0f9ed11e 2021-11-21T05:47:20.713 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-11-21T05:47:20.726 INFO:teuthology.task.internal:no buildpackages task found 2021-11-21T05:47:20.726 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-11-21T05:47:20.852 INFO:teuthology.task.internal:Saving configuration 2021-11-21T05:47:20.868 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-11-21T05:47:20.878 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-21T05:47:20.912 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 05:42:26.490406', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGm4bW+XsTqjIXeUZxz17Ok+/AoROXtynJTV5jjBBxq2gnG5ALbIBPEm+FWkcSccRBbbhAX4NNcr4nivDpG7Qio='} 2021-11-21T05:47:20.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 05:42:26.489225', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPE6iTkRR5//ufzKivXULmS6hX3uFFumO2GctNlBu1ZXlAg5RuxFHRlUdEm5CSyNaeu+dXC6Mr50d923Iq4lEBA='} 2021-11-21T05:47:20.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 05:42:26.487777', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAIysURxmi54brXmlLcWK/BqflWpcgAb55R2lK48vY+206hVxb7b+FV4qdEcRehm0/PuE4FnHl+VMNqZWEn/C9w='} 2021-11-21T05:47:20.971 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-11-21T05:47:20.979 INFO:teuthology.task.internal:roles: ubuntu@gibba001.front.sepia.ceph.com - ['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'] 2021-11-21T05:47:20.980 INFO:teuthology.task.internal:roles: ubuntu@gibba031.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'] 2021-11-21T05:47:20.980 INFO:teuthology.task.internal:roles: ubuntu@gibba038.front.sepia.ceph.com - ['client.0'] 2021-11-21T05:47:20.980 INFO:teuthology.run_tasks:Running task console_log... 2021-11-21T05:47:21.111 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f401b0c90d0>, signals=[15]) 2021-11-21T05:47:21.114 INFO:teuthology.run_tasks:Running task internal.connect... 2021-11-21T05:47:21.128 INFO:teuthology.task.internal:Opening connections... 2021-11-21T05:47:21.128 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba001.front.sepia.ceph.com 2021-11-21T05:47:21.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:47:21.205 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba031.front.sepia.ceph.com 2021-11-21T05:47:21.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:47:21.324 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba038.front.sepia.ceph.com 2021-11-21T05:47:21.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:47:21.392 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-11-21T05:47:21.402 DEBUG:teuthology.orchestra.run.gibba001:> uname -m 2021-11-21T05:47:21.416 INFO:teuthology.orchestra.run.gibba001.stdout:x86_64 2021-11-21T05:47:21.417 DEBUG:teuthology.orchestra.run.gibba001:> cat /etc/os-release 2021-11-21T05:47:21.468 INFO:teuthology.orchestra.run.gibba001.stdout:NAME="CentOS Linux" 2021-11-21T05:47:21.469 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION="8" 2021-11-21T05:47:21.469 INFO:teuthology.orchestra.run.gibba001.stdout:ID="centos" 2021-11-21T05:47:21.469 INFO:teuthology.orchestra.run.gibba001.stdout:ID_LIKE="rhel fedora" 2021-11-21T05:47:21.470 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION_ID="8" 2021-11-21T05:47:21.470 INFO:teuthology.orchestra.run.gibba001.stdout:PLATFORM_ID="platform:el8" 2021-11-21T05:47:21.470 INFO:teuthology.orchestra.run.gibba001.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-21T05:47:21.470 INFO:teuthology.orchestra.run.gibba001.stdout:ANSI_COLOR="0;31" 2021-11-21T05:47:21.471 INFO:teuthology.orchestra.run.gibba001.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-21T05:47:21.471 INFO:teuthology.orchestra.run.gibba001.stdout:HOME_URL="https://centos.org/" 2021-11-21T05:47:21.471 INFO:teuthology.orchestra.run.gibba001.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-21T05:47:21.471 INFO:teuthology.orchestra.run.gibba001.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-21T05:47:21.471 INFO:teuthology.orchestra.run.gibba001.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-21T05:47:21.472 INFO:teuthology.lock.ops:Updating gibba001.front.sepia.ceph.com on lock server 2021-11-21T05:47:21.499 DEBUG:teuthology.orchestra.run.gibba031:> uname -m 2021-11-21T05:47:21.512 INFO:teuthology.orchestra.run.gibba031.stdout:x86_64 2021-11-21T05:47:21.513 DEBUG:teuthology.orchestra.run.gibba031:> cat /etc/os-release 2021-11-21T05:47:21.563 INFO:teuthology.orchestra.run.gibba031.stdout:NAME="CentOS Linux" 2021-11-21T05:47:21.564 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION="8" 2021-11-21T05:47:21.564 INFO:teuthology.orchestra.run.gibba031.stdout:ID="centos" 2021-11-21T05:47:21.564 INFO:teuthology.orchestra.run.gibba031.stdout:ID_LIKE="rhel fedora" 2021-11-21T05:47:21.564 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_ID="8" 2021-11-21T05:47:21.564 INFO:teuthology.orchestra.run.gibba031.stdout:PLATFORM_ID="platform:el8" 2021-11-21T05:47:21.565 INFO:teuthology.orchestra.run.gibba031.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-21T05:47:21.565 INFO:teuthology.orchestra.run.gibba031.stdout:ANSI_COLOR="0;31" 2021-11-21T05:47:21.565 INFO:teuthology.orchestra.run.gibba031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-21T05:47:21.565 INFO:teuthology.orchestra.run.gibba031.stdout:HOME_URL="https://centos.org/" 2021-11-21T05:47:21.566 INFO:teuthology.orchestra.run.gibba031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-21T05:47:21.566 INFO:teuthology.orchestra.run.gibba031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-21T05:47:21.566 INFO:teuthology.orchestra.run.gibba031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-21T05:47:21.568 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server 2021-11-21T05:47:21.587 DEBUG:teuthology.orchestra.run.gibba038:> uname -m 2021-11-21T05:47:21.600 INFO:teuthology.orchestra.run.gibba038.stdout:x86_64 2021-11-21T05:47:21.601 DEBUG:teuthology.orchestra.run.gibba038:> cat /etc/os-release 2021-11-21T05:47:21.652 INFO:teuthology.orchestra.run.gibba038.stdout:NAME="CentOS Linux" 2021-11-21T05:47:21.653 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION="8" 2021-11-21T05:47:21.653 INFO:teuthology.orchestra.run.gibba038.stdout:ID="centos" 2021-11-21T05:47:21.653 INFO:teuthology.orchestra.run.gibba038.stdout:ID_LIKE="rhel fedora" 2021-11-21T05:47:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_ID="8" 2021-11-21T05:47:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:PLATFORM_ID="platform:el8" 2021-11-21T05:47:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-21T05:47:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:ANSI_COLOR="0;31" 2021-11-21T05:47:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-21T05:47:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:HOME_URL="https://centos.org/" 2021-11-21T05:47:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-21T05:47:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-21T05:47:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-21T05:47:21.656 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server 2021-11-21T05:47:21.676 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-11-21T05:47:21.691 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-11-21T05:47:21.709 INFO:teuthology.task.internal:Checking for old test directory... 2021-11-21T05:47:21.709 DEBUG:teuthology.orchestra.run.gibba001:> test '!' -e /home/ubuntu/cephtest 2021-11-21T05:47:21.713 DEBUG:teuthology.orchestra.run.gibba031:> test '!' -e /home/ubuntu/cephtest 2021-11-21T05:47:21.716 DEBUG:teuthology.orchestra.run.gibba038:> test '!' -e /home/ubuntu/cephtest 2021-11-21T05:47:21.728 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-11-21T05:47:21.738 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-11-21T05:47:21.739 DEBUG:teuthology.orchestra.run.gibba001:> test -z $(ls -A /var/lib/ceph) 2021-11-21T05:47:21.766 DEBUG:teuthology.orchestra.run.gibba031:> test -z $(ls -A /var/lib/ceph) 2021-11-21T05:47:21.769 DEBUG:teuthology.orchestra.run.gibba038:> test -z $(ls -A /var/lib/ceph) 2021-11-21T05:47:21.805 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-11-21T05:47:21.890 INFO:teuthology.run_tasks:Running task kernel... 2021-11-21T05:47:21.929 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-11-21T05:47:21.930 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-11-21T05:47:21.931 DEBUG:teuthology.orchestra.run.gibba001:> uname -r 2021-11-21T05:47:21.933 DEBUG:teuthology.orchestra.run.gibba031:> uname -r 2021-11-21T05:47:21.934 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-11-21T05:47:21.947 INFO:teuthology.orchestra.run.gibba031.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-11-21T05:47:21.948 INFO:teuthology.task.kernel:Running kernel on gibba031: 4.18.0-305.10.2.el8_4.x86_64 2021-11-21T05:47:21.948 DEBUG:teuthology.orchestra.run.gibba031:> sudo yum install -y kernel 2021-11-21T05:47:21.950 INFO:teuthology.orchestra.run.gibba038.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-11-21T05:47:21.951 INFO:teuthology.orchestra.run.gibba001.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-11-21T05:47:21.951 INFO:teuthology.task.kernel:Running kernel on gibba038: 4.18.0-305.10.2.el8_4.x86_64 2021-11-21T05:47:21.951 DEBUG:teuthology.orchestra.run.gibba038:> sudo yum install -y kernel 2021-11-21T05:47:21.952 INFO:teuthology.task.kernel:Running kernel on gibba001: 4.18.0-305.10.2.el8_4.x86_64 2021-11-21T05:47:21.952 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum install -y kernel 2021-11-21T05:47:24.028 INFO:teuthology.orchestra.run.gibba031.stdout:CentOS-8 - AppStream 21 MB/s | 8.1 MB 00:00 2021-11-21T05:47:24.182 INFO:teuthology.orchestra.run.gibba001.stdout:CentOS-8 - AppStream 18 MB/s | 8.1 MB 00:00 2021-11-21T05:47:24.241 INFO:teuthology.orchestra.run.gibba038.stdout:CentOS-8 - AppStream 14 MB/s | 8.1 MB 00:00 2021-11-21T05:47:25.150 INFO:teuthology.orchestra.run.gibba031.stdout:CentOS-8 - Base 22 MB/s | 3.5 MB 00:00 2021-11-21T05:47:25.408 INFO:teuthology.orchestra.run.gibba001.stdout:CentOS-8 - Base 12 MB/s | 3.5 MB 00:00 2021-11-21T05:47:25.420 INFO:teuthology.orchestra.run.gibba038.stdout:CentOS-8 - Base 14 MB/s | 3.5 MB 00:00 2021-11-21T05:47:25.612 INFO:teuthology.orchestra.run.gibba031.stdout:CentOS-8 - Extras 132 kB/s | 10 kB 00:00 2021-11-21T05:47:25.847 INFO:teuthology.orchestra.run.gibba001.stdout:CentOS-8 - Extras 158 kB/s | 10 kB 00:00 2021-11-21T05:47:25.870 INFO:teuthology.orchestra.run.gibba038.stdout:CentOS-8 - Extras 150 kB/s | 10 kB 00:00 2021-11-21T05:47:28.626 INFO:teuthology.orchestra.run.gibba031.stdout:CentOS Linux 8 - AppStream 2.7 MB/s | 8.1 MB 00:02 2021-11-21T05:47:28.675 INFO:teuthology.orchestra.run.gibba001.stdout:CentOS Linux 8 - AppStream 2.9 MB/s | 8.1 MB 00:02 2021-11-21T05:47:28.823 INFO:teuthology.orchestra.run.gibba038.stdout:CentOS Linux 8 - AppStream 2.8 MB/s | 8.1 MB 00:02 2021-11-21T05:47:33.972 INFO:teuthology.orchestra.run.gibba001.stdout:CentOS Linux 8 - BaseOS 822 kB/s | 3.5 MB 00:04 2021-11-21T05:47:34.724 INFO:teuthology.orchestra.run.gibba031.stdout:CentOS Linux 8 - BaseOS 699 kB/s | 3.5 MB 00:05 2021-11-21T05:47:34.780 INFO:teuthology.orchestra.run.gibba001.stdout:CentOS Linux 8 - Extras 24 kB/s | 10 kB 00:00 2021-11-21T05:47:34.992 INFO:teuthology.orchestra.run.gibba001.stdout:CentOS-8 - PowerTools 14 MB/s | 2.3 MB 00:00 2021-11-21T05:47:35.683 INFO:teuthology.orchestra.run.gibba031.stdout:CentOS Linux 8 - Extras 18 kB/s | 10 kB 00:00 2021-11-21T05:47:35.869 INFO:teuthology.orchestra.run.gibba031.stdout:CentOS-8 - PowerTools 16 MB/s | 2.3 MB 00:00 2021-11-21T05:47:37.611 INFO:teuthology.orchestra.run.gibba001.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2021-11-21T05:47:38.085 INFO:teuthology.orchestra.run.gibba031.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-11-21T05:47:38.600 INFO:teuthology.orchestra.run.gibba001.stdout:Extra Packages for Enterprise Linux 11 MB/s | 11 MB 00:00 2021-11-21T05:47:39.044 INFO:teuthology.orchestra.run.gibba031.stdout:Extra Packages for Enterprise Linux 12 MB/s | 11 MB 00:00 2021-11-21T05:47:40.295 INFO:teuthology.orchestra.run.gibba001.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2021-11-21T05:47:40.784 INFO:teuthology.orchestra.run.gibba031.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2021-11-21T05:47:41.772 INFO:teuthology.orchestra.run.gibba001.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-11-21T05:47:41.773 INFO:teuthology.orchestra.run.gibba001.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-21T05:47:42.020 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-11-21T05:47:42.021 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-11-21T05:47:42.022 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-11-21T05:47:42.022 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-11-21T05:47:42.022 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-11-21T05:47:42.022 INFO:teuthology.orchestra.run.gibba001.stdout: kernel x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 7.0 M 2021-11-21T05:47:42.023 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-11-21T05:47:42.023 INFO:teuthology.orchestra.run.gibba001.stdout: kernel-core x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 38 M 2021-11-21T05:47:42.023 INFO:teuthology.orchestra.run.gibba001.stdout: kernel-modules x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 30 M 2021-11-21T05:47:42.024 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-11-21T05:47:42.024 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-11-21T05:47:42.025 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-11-21T05:47:42.025 INFO:teuthology.orchestra.run.gibba001.stdout:Install 3 Packages 2021-11-21T05:47:42.025 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-11-21T05:47:42.026 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 74 M 2021-11-21T05:47:42.026 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 90 M 2021-11-21T05:47:42.026 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-11-21T05:47:42.255 INFO:teuthology.orchestra.run.gibba031.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-11-21T05:47:42.255 INFO:teuthology.orchestra.run.gibba031.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-21T05:47:42.496 INFO:teuthology.orchestra.run.gibba031.stdout:Dependencies resolved. 2021-11-21T05:47:42.497 INFO:teuthology.orchestra.run.gibba031.stdout:================================================================================ 2021-11-21T05:47:42.498 INFO:teuthology.orchestra.run.gibba031.stdout: Package Arch Version Repository Size 2021-11-21T05:47:42.498 INFO:teuthology.orchestra.run.gibba031.stdout:================================================================================ 2021-11-21T05:47:42.498 INFO:teuthology.orchestra.run.gibba031.stdout:Installing: 2021-11-21T05:47:42.498 INFO:teuthology.orchestra.run.gibba031.stdout: kernel x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 7.0 M 2021-11-21T05:47:42.499 INFO:teuthology.orchestra.run.gibba031.stdout:Installing dependencies: 2021-11-21T05:47:42.499 INFO:teuthology.orchestra.run.gibba031.stdout: kernel-core x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 38 M 2021-11-21T05:47:42.499 INFO:teuthology.orchestra.run.gibba031.stdout: kernel-modules x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 30 M 2021-11-21T05:47:42.499 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-21T05:47:42.500 INFO:teuthology.orchestra.run.gibba031.stdout:Transaction Summary 2021-11-21T05:47:42.500 INFO:teuthology.orchestra.run.gibba031.stdout:================================================================================ 2021-11-21T05:47:42.500 INFO:teuthology.orchestra.run.gibba031.stdout:Install 3 Packages 2021-11-21T05:47:42.500 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-21T05:47:42.500 INFO:teuthology.orchestra.run.gibba031.stdout:Total download size: 74 M 2021-11-21T05:47:42.501 INFO:teuthology.orchestra.run.gibba031.stdout:Installed size: 90 M 2021-11-21T05:47:42.501 INFO:teuthology.orchestra.run.gibba031.stdout:Downloading Packages: 2021-11-21T05:47:43.138 INFO:teuthology.orchestra.run.gibba001.stdout:(1/3): kernel-4.18.0-348.2.1.el8_5.x86_64.rpm 6.3 MB/s | 7.0 MB 00:01 2021-11-21T05:47:43.342 INFO:teuthology.orchestra.run.gibba038.stdout:CentOS Linux 8 - BaseOS 264 kB/s | 3.5 MB 00:13 2021-11-21T05:47:44.308 INFO:teuthology.orchestra.run.gibba031.stdout:(1/3): kernel-4.18.0-348.2.1.el8_5.x86_64.rpm 3.9 MB/s | 7.0 MB 00:01 2021-11-21T05:47:44.311 INFO:teuthology.orchestra.run.gibba038.stdout:CentOS Linux 8 - Extras 18 kB/s | 10 kB 00:00 2021-11-21T05:47:45.204 INFO:teuthology.orchestra.run.gibba001.stdout:(2/3): kernel-modules-4.18.0-348.2.1.el8_5.x86_ 9.4 MB/s | 30 MB 00:03 2021-11-21T05:47:45.826 INFO:teuthology.orchestra.run.gibba038.stdout:CentOS-8 - PowerTools 1.6 MB/s | 2.3 MB 00:01 2021-11-21T05:47:45.906 INFO:teuthology.orchestra.run.gibba001.stdout:(3/3): kernel-core-4.18.0-348.2.1.el8_5.x86_64. 9.7 MB/s | 38 MB 00:03 2021-11-21T05:47:45.908 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-11-21T05:47:45.909 INFO:teuthology.orchestra.run.gibba001.stdout:Total 19 MB/s | 74 MB 00:03 2021-11-21T05:47:45.970 INFO:teuthology.orchestra.run.gibba031.stdout:(2/3): kernel-modules-4.18.0-348.2.1.el8_5.x86_ 8.6 MB/s | 30 MB 00:03 2021-11-21T05:47:46.007 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-11-21T05:47:46.285 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-11-21T05:47:46.285 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-11-21T05:47:46.308 INFO:teuthology.orchestra.run.gibba031.stdout:(3/3): kernel-core-4.18.0-348.2.1.el8_5.x86_64. 9.9 MB/s | 38 MB 00:03 2021-11-21T05:47:46.310 INFO:teuthology.orchestra.run.gibba031.stdout:-------------------------------------------------------------------------------- 2021-11-21T05:47:46.310 INFO:teuthology.orchestra.run.gibba031.stdout:Total 19 MB/s | 74 MB 00:03 2021-11-21T05:47:46.407 INFO:teuthology.orchestra.run.gibba031.stdout:Running transaction check 2021-11-21T05:47:46.670 INFO:teuthology.orchestra.run.gibba031.stdout:Transaction check succeeded. 2021-11-21T05:47:46.670 INFO:teuthology.orchestra.run.gibba031.stdout:Running transaction test 2021-11-21T05:47:47.318 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-11-21T05:47:47.348 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-11-21T05:47:47.673 INFO:teuthology.orchestra.run.gibba031.stdout:Transaction test succeeded. 2021-11-21T05:47:47.706 INFO:teuthology.orchestra.run.gibba031.stdout:Running transaction 2021-11-21T05:47:48.437 INFO:teuthology.orchestra.run.gibba038.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2021-11-21T05:47:49.250 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-11-21T05:47:49.270 INFO:teuthology.orchestra.run.gibba038.stdout:Extra Packages for Enterprise Linux 14 MB/s | 11 MB 00:00 2021-11-21T05:47:49.575 INFO:teuthology.orchestra.run.gibba031.stdout: Preparing : 1/1 2021-11-21T05:47:49.691 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:47:50.008 INFO:teuthology.orchestra.run.gibba031.stdout: Installing : kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:47:50.971 INFO:teuthology.orchestra.run.gibba038.stdout:lab-extras 5.1 MB/s | 24 kB 00:00 2021-11-21T05:47:52.088 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:47:52.375 INFO:teuthology.orchestra.run.gibba031.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:47:52.441 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:47:52.451 INFO:teuthology.orchestra.run.gibba038.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-11-21T05:47:52.451 INFO:teuthology.orchestra.run.gibba038.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-21T05:47:52.682 INFO:teuthology.orchestra.run.gibba031.stdout: Installing : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:47:52.713 INFO:teuthology.orchestra.run.gibba038.stdout:Dependencies resolved. 2021-11-21T05:47:52.714 INFO:teuthology.orchestra.run.gibba038.stdout:================================================================================ 2021-11-21T05:47:52.715 INFO:teuthology.orchestra.run.gibba038.stdout: Package Arch Version Repository Size 2021-11-21T05:47:52.715 INFO:teuthology.orchestra.run.gibba038.stdout:================================================================================ 2021-11-21T05:47:52.715 INFO:teuthology.orchestra.run.gibba038.stdout:Installing: 2021-11-21T05:47:52.715 INFO:teuthology.orchestra.run.gibba038.stdout: kernel x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 7.0 M 2021-11-21T05:47:52.716 INFO:teuthology.orchestra.run.gibba038.stdout:Installing dependencies: 2021-11-21T05:47:52.716 INFO:teuthology.orchestra.run.gibba038.stdout: kernel-core x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 38 M 2021-11-21T05:47:52.716 INFO:teuthology.orchestra.run.gibba038.stdout: kernel-modules x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 30 M 2021-11-21T05:47:52.716 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-21T05:47:52.716 INFO:teuthology.orchestra.run.gibba038.stdout:Transaction Summary 2021-11-21T05:47:52.717 INFO:teuthology.orchestra.run.gibba038.stdout:================================================================================ 2021-11-21T05:47:52.717 INFO:teuthology.orchestra.run.gibba038.stdout:Install 3 Packages 2021-11-21T05:47:52.717 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-21T05:47:52.717 INFO:teuthology.orchestra.run.gibba038.stdout:Total download size: 74 M 2021-11-21T05:47:52.718 INFO:teuthology.orchestra.run.gibba038.stdout:Installed size: 90 M 2021-11-21T05:47:52.718 INFO:teuthology.orchestra.run.gibba038.stdout:Downloading Packages: 2021-11-21T05:47:54.085 INFO:teuthology.orchestra.run.gibba038.stdout:(1/3): kernel-4.18.0-348.2.1.el8_5.x86_64.rpm 5.1 MB/s | 7.0 MB 00:01 2021-11-21T05:47:54.896 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:47:55.053 INFO:teuthology.orchestra.run.gibba038.stdout:(2/3): kernel-modules-4.18.0-348.2.1.el8_5.x86_ 13 MB/s | 30 MB 00:02 2021-11-21T05:47:55.080 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:47:55.127 INFO:teuthology.orchestra.run.gibba031.stdout: Running scriptlet: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:47:55.329 INFO:teuthology.orchestra.run.gibba031.stdout: Installing : kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:47:55.625 INFO:teuthology.orchestra.run.gibba038.stdout:(3/3): kernel-core-4.18.0-348.2.1.el8_5.x86_64. 13 MB/s | 38 MB 00:02 2021-11-21T05:47:55.627 INFO:teuthology.orchestra.run.gibba038.stdout:-------------------------------------------------------------------------------- 2021-11-21T05:47:55.627 INFO:teuthology.orchestra.run.gibba038.stdout:Total 26 MB/s | 74 MB 00:02 2021-11-21T05:47:55.726 INFO:teuthology.orchestra.run.gibba038.stdout:Running transaction check 2021-11-21T05:47:55.983 INFO:teuthology.orchestra.run.gibba038.stdout:Transaction check succeeded. 2021-11-21T05:47:55.984 INFO:teuthology.orchestra.run.gibba038.stdout:Running transaction test 2021-11-21T05:47:56.990 INFO:teuthology.orchestra.run.gibba038.stdout:Transaction test succeeded. 2021-11-21T05:47:57.010 INFO:teuthology.orchestra.run.gibba038.stdout:Running transaction 2021-11-21T05:47:58.962 INFO:teuthology.orchestra.run.gibba038.stdout: Preparing : 1/1 2021-11-21T05:47:59.452 INFO:teuthology.orchestra.run.gibba038.stdout: Installing : kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:48:01.795 INFO:teuthology.orchestra.run.gibba038.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:48:02.119 INFO:teuthology.orchestra.run.gibba038.stdout: Installing : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:48:04.567 INFO:teuthology.orchestra.run.gibba038.stdout: Running scriptlet: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:48:04.782 INFO:teuthology.orchestra.run.gibba038.stdout: Installing : kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:10.553 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:10.783 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:10.783 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : kernel-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:48:10.784 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : kernel-core-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:48:10.954 INFO:teuthology.orchestra.run.gibba031.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:11.116 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:11.116 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-11-21T05:48:11.117 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-11-21T05:48:11.117 INFO:teuthology.orchestra.run.gibba001.stdout: kernel-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.117 INFO:teuthology.orchestra.run.gibba001.stdout: kernel-core-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.117 INFO:teuthology.orchestra.run.gibba001.stdout: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.118 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-11-21T05:48:11.118 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-11-21T05:48:11.187 DEBUG:teuthology.orchestra.run.gibba001:> rpm -q kernel --last | head -n 1 2021-11-21T05:48:11.277 INFO:teuthology.orchestra.run.gibba031.stdout: Running scriptlet: kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:11.277 INFO:teuthology.orchestra.run.gibba031.stdout: Verifying : kernel-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:48:11.278 INFO:teuthology.orchestra.run.gibba031.stdout: Verifying : kernel-core-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:48:11.306 INFO:teuthology.orchestra.run.gibba001.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Sun 21 Nov 2021 05:47:54 AM UTC 2021-11-21T05:48:11.308 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.308 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.309 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-21T05:48:11.309 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-21T05:48:11.309 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-11-21T05:48:11.309 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba001.front.sepia.ceph.com, path=None, version=distro) 2021-11-21T05:48:11.310 DEBUG:teuthology.orchestra.run.gibba001:> rpm -q kernel --last | head -n 1 2021-11-21T05:48:11.416 INFO:teuthology.orchestra.run.gibba001.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Sun 21 Nov 2021 05:47:54 AM UTC 2021-11-21T05:48:11.417 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.418 DEBUG:teuthology.orchestra.run.gibba001:> sudo rpm -qi grub2-tools 2021-11-21T05:48:11.442 INFO:teuthology.orchestra.run.gibba001.stdout:Name : grub2-tools 2021-11-21T05:48:11.443 INFO:teuthology.orchestra.run.gibba001.stdout:Epoch : 1 2021-11-21T05:48:11.443 INFO:teuthology.orchestra.run.gibba001.stdout:Version : 2.02 2021-11-21T05:48:11.443 INFO:teuthology.orchestra.run.gibba001.stdout:Release : 90.el8 2021-11-21T05:48:11.443 INFO:teuthology.orchestra.run.gibba001.stdout:Architecture: x86_64 2021-11-21T05:48:11.444 INFO:teuthology.orchestra.run.gibba001.stdout:Install Date: Wed 11 Aug 2021 06:37:40 PM UTC 2021-11-21T05:48:11.444 INFO:teuthology.orchestra.run.gibba001.stdout:Group : System Environment/Base 2021-11-21T05:48:11.444 INFO:teuthology.orchestra.run.gibba001.stdout:Size : 9197207 2021-11-21T05:48:11.444 INFO:teuthology.orchestra.run.gibba001.stdout:License : GPLv3+ 2021-11-21T05:48:11.445 INFO:teuthology.orchestra.run.gibba001.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-11-21T05:48:11.445 INFO:teuthology.orchestra.run.gibba001.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-11-21T05:48:11.445 INFO:teuthology.orchestra.run.gibba001.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-11-21T05:48:11.445 INFO:teuthology.orchestra.run.gibba001.stdout:Build Host : kbuilder.bsys.centos.org 2021-11-21T05:48:11.445 INFO:teuthology.orchestra.run.gibba001.stdout:Relocations : (not relocatable) 2021-11-21T05:48:11.446 INFO:teuthology.orchestra.run.gibba001.stdout:Packager : CentOS BuildSystem 2021-11-21T05:48:11.446 INFO:teuthology.orchestra.run.gibba001.stdout:Vendor : CentOS 2021-11-21T05:48:11.446 INFO:teuthology.orchestra.run.gibba001.stdout:URL : http://www.gnu.org/software/grub/ 2021-11-21T05:48:11.446 INFO:teuthology.orchestra.run.gibba001.stdout:Summary : Support tools for GRUB. 2021-11-21T05:48:11.447 INFO:teuthology.orchestra.run.gibba001.stdout:Description : 2021-11-21T05:48:11.447 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-11-21T05:48:11.447 INFO:teuthology.orchestra.run.gibba001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-11-21T05:48:11.447 INFO:teuthology.orchestra.run.gibba001.stdout:customizable bootloader with modular architecture. It supports a rich 2021-11-21T05:48:11.447 INFO:teuthology.orchestra.run.gibba001.stdout:variety of kernel formats, file systems, computer architectures and 2021-11-21T05:48:11.448 INFO:teuthology.orchestra.run.gibba001.stdout:hardware devices. 2021-11-21T05:48:11.448 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-11-21T05:48:11.448 INFO:teuthology.orchestra.run.gibba001.stdout:This subpackage provides tools for support of all platforms. 2021-11-21T05:48:11.449 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-11-21T05:48:11.449 INFO:teuthology.task.kernel:Updating grub on gibba001 to boot 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.450 DEBUG:teuthology.orchestra.run.gibba001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-11-21T05:48:11.562 INFO:teuthology.orchestra.run.gibba031.stdout: Verifying : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:11.562 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-21T05:48:11.563 INFO:teuthology.orchestra.run.gibba031.stdout:Installed: 2021-11-21T05:48:11.563 INFO:teuthology.orchestra.run.gibba031.stdout: kernel-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.563 INFO:teuthology.orchestra.run.gibba031.stdout: kernel-core-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.563 INFO:teuthology.orchestra.run.gibba031.stdout: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.564 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-21T05:48:11.564 INFO:teuthology.orchestra.run.gibba031.stdout:Complete! 2021-11-21T05:48:11.651 DEBUG:teuthology.orchestra.run.gibba031:> rpm -q kernel --last | head -n 1 2021-11-21T05:48:11.765 INFO:teuthology.orchestra.run.gibba031.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Sun 21 Nov 2021 05:47:55 AM UTC 2021-11-21T05:48:11.767 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.767 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.767 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-21T05:48:11.767 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-21T05:48:11.768 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-11-21T05:48:11.768 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba031.front.sepia.ceph.com, path=None, version=distro) 2021-11-21T05:48:11.768 DEBUG:teuthology.orchestra.run.gibba031:> rpm -q kernel --last | head -n 1 2021-11-21T05:48:11.873 INFO:teuthology.orchestra.run.gibba031.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Sun 21 Nov 2021 05:47:55 AM UTC 2021-11-21T05:48:11.874 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.875 DEBUG:teuthology.orchestra.run.gibba031:> sudo rpm -qi grub2-tools 2021-11-21T05:48:11.898 INFO:teuthology.orchestra.run.gibba031.stdout:Name : grub2-tools 2021-11-21T05:48:11.898 INFO:teuthology.orchestra.run.gibba031.stdout:Epoch : 1 2021-11-21T05:48:11.899 INFO:teuthology.orchestra.run.gibba031.stdout:Version : 2.02 2021-11-21T05:48:11.899 INFO:teuthology.orchestra.run.gibba031.stdout:Release : 90.el8 2021-11-21T05:48:11.899 INFO:teuthology.orchestra.run.gibba031.stdout:Architecture: x86_64 2021-11-21T05:48:11.899 INFO:teuthology.orchestra.run.gibba031.stdout:Install Date: Wed 11 Aug 2021 06:37:40 PM UTC 2021-11-21T05:48:11.900 INFO:teuthology.orchestra.run.gibba031.stdout:Group : System Environment/Base 2021-11-21T05:48:11.900 INFO:teuthology.orchestra.run.gibba031.stdout:Size : 9197207 2021-11-21T05:48:11.900 INFO:teuthology.orchestra.run.gibba031.stdout:License : GPLv3+ 2021-11-21T05:48:11.900 INFO:teuthology.orchestra.run.gibba031.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-11-21T05:48:11.901 INFO:teuthology.orchestra.run.gibba031.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-11-21T05:48:11.901 INFO:teuthology.orchestra.run.gibba031.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-11-21T05:48:11.901 INFO:teuthology.orchestra.run.gibba031.stdout:Build Host : kbuilder.bsys.centos.org 2021-11-21T05:48:11.901 INFO:teuthology.orchestra.run.gibba031.stdout:Relocations : (not relocatable) 2021-11-21T05:48:11.902 INFO:teuthology.orchestra.run.gibba031.stdout:Packager : CentOS BuildSystem 2021-11-21T05:48:11.902 INFO:teuthology.orchestra.run.gibba031.stdout:Vendor : CentOS 2021-11-21T05:48:11.902 INFO:teuthology.orchestra.run.gibba031.stdout:URL : http://www.gnu.org/software/grub/ 2021-11-21T05:48:11.903 INFO:teuthology.orchestra.run.gibba031.stdout:Summary : Support tools for GRUB. 2021-11-21T05:48:11.903 INFO:teuthology.orchestra.run.gibba031.stdout:Description : 2021-11-21T05:48:11.903 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-21T05:48:11.903 INFO:teuthology.orchestra.run.gibba031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-11-21T05:48:11.904 INFO:teuthology.orchestra.run.gibba031.stdout:customizable bootloader with modular architecture. It supports a rich 2021-11-21T05:48:11.904 INFO:teuthology.orchestra.run.gibba031.stdout:variety of kernel formats, file systems, computer architectures and 2021-11-21T05:48:11.904 INFO:teuthology.orchestra.run.gibba031.stdout:hardware devices. 2021-11-21T05:48:11.904 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-21T05:48:11.904 INFO:teuthology.orchestra.run.gibba031.stdout:This subpackage provides tools for support of all platforms. 2021-11-21T05:48:11.906 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-11-21T05:48:11.906 INFO:teuthology.task.kernel:Updating grub on gibba031 to boot 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:11.906 DEBUG:teuthology.orchestra.run.gibba031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-11-21T05:48:13.029 INFO:teuthology.orchestra.run.gibba001.stderr:Generating grub configuration file ... 2021-11-21T05:48:13.184 INFO:teuthology.orchestra.run.gibba031.stderr:Generating grub configuration file ... 2021-11-21T05:48:14.850 INFO:teuthology.orchestra.run.gibba001.stderr:done 2021-11-21T05:48:14.852 DEBUG:teuthology.orchestra.run.gibba001:> mktemp 2021-11-21T05:48:14.901 INFO:teuthology.orchestra.run.gibba031.stderr:done 2021-11-21T05:48:14.911 INFO:teuthology.orchestra.run.gibba001.stdout:/tmp/tmp.JsZpAHjpRj 2021-11-21T05:48:14.911 DEBUG:teuthology.orchestra.run.gibba001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JsZpAHjpRj 2021-11-21T05:48:14.913 DEBUG:teuthology.orchestra.run.gibba031:> mktemp 2021-11-21T05:48:14.933 DEBUG:teuthology.orchestra.run.gibba001:> sudo chmod 0666 /tmp/tmp.JsZpAHjpRj 2021-11-21T05:48:14.944 INFO:teuthology.orchestra.run.gibba031.stdout:/tmp/tmp.43gmvGwdML 2021-11-21T05:48:14.945 DEBUG:teuthology.orchestra.run.gibba031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.43gmvGwdML 2021-11-21T05:48:15.006 DEBUG:teuthology.orchestra.run.gibba031:> sudo chmod 0666 /tmp/tmp.43gmvGwdML 2021-11-21T05:48:15.086 DEBUG:teuthology.orchestra.remote:gibba001:/tmp/tmp.JsZpAHjpRj is 6KB 2021-11-21T05:48:15.135 DEBUG:teuthology.orchestra.run.gibba001:> rm -fr /tmp/tmp.JsZpAHjpRj 2021-11-21T05:48:15.142 DEBUG:teuthology.orchestra.remote:gibba031:/tmp/tmp.43gmvGwdML is 6KB 2021-11-21T05:48:15.146 DEBUG:teuthology.orchestra.run.gibba001:> sudo /bin/ls /boot/loader/entries || true 2021-11-21T05:48:15.197 DEBUG:teuthology.orchestra.run.gibba031:> rm -fr /tmp/tmp.43gmvGwdML 2021-11-21T05:48:15.209 DEBUG:teuthology.orchestra.run.gibba031:> sudo /bin/ls /boot/loader/entries || true 2021-11-21T05:48:15.210 INFO:teuthology.orchestra.run.gibba001.stdout:a2301e55c861490cbf6521f4f4e1b770-0-rescue.conf 2021-11-21T05:48:15.211 INFO:teuthology.orchestra.run.gibba001.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-240.el8.x86_64.conf 2021-11-21T05:48:15.211 INFO:teuthology.orchestra.run.gibba001.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-305.10.2.el8_4.x86_64.conf 2021-11-21T05:48:15.211 INFO:teuthology.orchestra.run.gibba001.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64.conf 2021-11-21T05:48:15.212 DEBUG:teuthology.orchestra.run.gibba001:> sudo grub2-set-default a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:15.267 INFO:teuthology.orchestra.run.gibba031.stdout:a2301e55c861490cbf6521f4f4e1b770-0-rescue.conf 2021-11-21T05:48:15.267 INFO:teuthology.orchestra.run.gibba031.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-240.el8.x86_64.conf 2021-11-21T05:48:15.267 INFO:teuthology.orchestra.run.gibba031.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-305.10.2.el8_4.x86_64.conf 2021-11-21T05:48:15.268 INFO:teuthology.orchestra.run.gibba031.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64.conf 2021-11-21T05:48:15.269 DEBUG:teuthology.orchestra.run.gibba031:> sudo grub2-set-default a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:15.351 DEBUG:teuthology.orchestra.run.gibba001:> sudo shutdown -r now 2021-11-21T05:48:15.429 DEBUG:teuthology.orchestra.run.gibba031:> sudo shutdown -r now 2021-11-21T05:48:20.195 INFO:teuthology.orchestra.run.gibba038.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:20.435 INFO:teuthology.orchestra.run.gibba038.stdout: Running scriptlet: kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:20.435 INFO:teuthology.orchestra.run.gibba038.stdout: Verifying : kernel-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-21T05:48:20.435 INFO:teuthology.orchestra.run.gibba038.stdout: Verifying : kernel-core-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-21T05:48:20.744 INFO:teuthology.orchestra.run.gibba038.stdout: Verifying : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-21T05:48:20.744 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-21T05:48:20.744 INFO:teuthology.orchestra.run.gibba038.stdout:Installed: 2021-11-21T05:48:20.745 INFO:teuthology.orchestra.run.gibba038.stdout: kernel-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:20.745 INFO:teuthology.orchestra.run.gibba038.stdout: kernel-core-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:20.745 INFO:teuthology.orchestra.run.gibba038.stdout: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:20.745 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-21T05:48:20.746 INFO:teuthology.orchestra.run.gibba038.stdout:Complete! 2021-11-21T05:48:20.802 DEBUG:teuthology.orchestra.run.gibba038:> rpm -q kernel --last | head -n 1 2021-11-21T05:48:20.962 INFO:teuthology.orchestra.run.gibba038.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Sun 21 Nov 2021 05:48:04 AM UTC 2021-11-21T05:48:20.963 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:20.964 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:20.964 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-21T05:48:20.964 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-21T05:48:20.965 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-11-21T05:48:20.965 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba038.front.sepia.ceph.com, path=None, version=distro) 2021-11-21T05:48:20.965 DEBUG:teuthology.orchestra.run.gibba038:> rpm -q kernel --last | head -n 1 2021-11-21T05:48:21.071 INFO:teuthology.orchestra.run.gibba038.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Sun 21 Nov 2021 05:48:04 AM UTC 2021-11-21T05:48:21.073 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:21.073 DEBUG:teuthology.orchestra.run.gibba038:> sudo rpm -qi grub2-tools 2021-11-21T05:48:21.096 INFO:teuthology.orchestra.run.gibba038.stdout:Name : grub2-tools 2021-11-21T05:48:21.097 INFO:teuthology.orchestra.run.gibba038.stdout:Epoch : 1 2021-11-21T05:48:21.097 INFO:teuthology.orchestra.run.gibba038.stdout:Version : 2.02 2021-11-21T05:48:21.097 INFO:teuthology.orchestra.run.gibba038.stdout:Release : 90.el8 2021-11-21T05:48:21.098 INFO:teuthology.orchestra.run.gibba038.stdout:Architecture: x86_64 2021-11-21T05:48:21.098 INFO:teuthology.orchestra.run.gibba038.stdout:Install Date: Wed 11 Aug 2021 06:37:40 PM UTC 2021-11-21T05:48:21.098 INFO:teuthology.orchestra.run.gibba038.stdout:Group : System Environment/Base 2021-11-21T05:48:21.098 INFO:teuthology.orchestra.run.gibba038.stdout:Size : 9197207 2021-11-21T05:48:21.099 INFO:teuthology.orchestra.run.gibba038.stdout:License : GPLv3+ 2021-11-21T05:48:21.099 INFO:teuthology.orchestra.run.gibba038.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-11-21T05:48:21.099 INFO:teuthology.orchestra.run.gibba038.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-11-21T05:48:21.099 INFO:teuthology.orchestra.run.gibba038.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-11-21T05:48:21.099 INFO:teuthology.orchestra.run.gibba038.stdout:Build Host : kbuilder.bsys.centos.org 2021-11-21T05:48:21.100 INFO:teuthology.orchestra.run.gibba038.stdout:Relocations : (not relocatable) 2021-11-21T05:48:21.100 INFO:teuthology.orchestra.run.gibba038.stdout:Packager : CentOS BuildSystem 2021-11-21T05:48:21.100 INFO:teuthology.orchestra.run.gibba038.stdout:Vendor : CentOS 2021-11-21T05:48:21.100 INFO:teuthology.orchestra.run.gibba038.stdout:URL : http://www.gnu.org/software/grub/ 2021-11-21T05:48:21.101 INFO:teuthology.orchestra.run.gibba038.stdout:Summary : Support tools for GRUB. 2021-11-21T05:48:21.101 INFO:teuthology.orchestra.run.gibba038.stdout:Description : 2021-11-21T05:48:21.101 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-21T05:48:21.101 INFO:teuthology.orchestra.run.gibba038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-11-21T05:48:21.101 INFO:teuthology.orchestra.run.gibba038.stdout:customizable bootloader with modular architecture. It supports a rich 2021-11-21T05:48:21.102 INFO:teuthology.orchestra.run.gibba038.stdout:variety of kernel formats, file systems, computer architectures and 2021-11-21T05:48:21.102 INFO:teuthology.orchestra.run.gibba038.stdout:hardware devices. 2021-11-21T05:48:21.102 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-21T05:48:21.102 INFO:teuthology.orchestra.run.gibba038.stdout:This subpackage provides tools for support of all platforms. 2021-11-21T05:48:21.103 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-11-21T05:48:21.104 INFO:teuthology.task.kernel:Updating grub on gibba038 to boot 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:21.104 DEBUG:teuthology.orchestra.run.gibba038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-11-21T05:48:22.529 INFO:teuthology.orchestra.run.gibba038.stderr:Generating grub configuration file ... 2021-11-21T05:48:24.195 INFO:teuthology.orchestra.run.gibba038.stderr:done 2021-11-21T05:48:24.202 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-11-21T05:48:24.239 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.sN4TSXycDq 2021-11-21T05:48:24.239 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sN4TSXycDq 2021-11-21T05:48:24.301 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.sN4TSXycDq 2021-11-21T05:48:24.434 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.sN4TSXycDq is 6KB 2021-11-21T05:48:24.483 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.sN4TSXycDq 2021-11-21T05:48:24.495 DEBUG:teuthology.orchestra.run.gibba038:> sudo /bin/ls /boot/loader/entries || true 2021-11-21T05:48:24.552 INFO:teuthology.orchestra.run.gibba038.stdout:a2301e55c861490cbf6521f4f4e1b770-0-rescue.conf 2021-11-21T05:48:24.552 INFO:teuthology.orchestra.run.gibba038.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-240.el8.x86_64.conf 2021-11-21T05:48:24.552 INFO:teuthology.orchestra.run.gibba038.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-305.10.2.el8_4.x86_64.conf 2021-11-21T05:48:24.553 INFO:teuthology.orchestra.run.gibba038.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64.conf 2021-11-21T05:48:24.554 DEBUG:teuthology.orchestra.run.gibba038:> sudo grub2-set-default a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:48:24.695 DEBUG:teuthology.orchestra.run.gibba038:> sudo shutdown -r now 2021-11-21T05:48:45.370 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-11-21T05:48:45.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba001.front.sepia.ceph.com' 2021-11-21T05:48:45.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:48:45.433 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-11-21T05:48:45.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba031.front.sepia.ceph.com' 2021-11-21T05:48:45.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:48:54.706 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-11-21T05:48:54.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-21T05:48:54.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:50:03.867 DEBUG:teuthology.orchestra.remote:timed out 2021-11-21T05:50:03.868 DEBUG:teuthology.orchestra.remote:timed out 2021-11-21T05:50:13.047 DEBUG:teuthology.orchestra.remote:timed out 2021-11-21T05:50:33.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba001.front.sepia.ceph.com' 2021-11-21T05:50:33.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:50:33.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba031.front.sepia.ceph.com' 2021-11-21T05:50:33.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:50:34.220 DEBUG:teuthology.orchestra.run.gibba031:> true 2021-11-21T05:50:34.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@gibba031.front.sepia.ceph.com' 2021-11-21T05:50:34.487 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-348.2.1.el8_5.x86_64"... 2021-11-21T05:50:34.488 DEBUG:teuthology.orchestra.run.gibba031:> uname -r 2021-11-21T05:50:34.539 INFO:teuthology.orchestra.run.gibba031.stdout:4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:50:34.539 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-348.2.1.el8_5.x86_64 vs 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:50:34.540 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-21T05:50:34.540 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-11-21T05:50:35.541 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-11-21T05:50:35.542 DEBUG:teuthology.orchestra.run.gibba031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-21T05:50:35.600 INFO:teuthology.orchestra.run.gibba031.stdout:ttyS1 2021-11-21T05:50:35.612 DEBUG:teuthology.parallel:result is None 2021-11-21T05:50:43.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-21T05:50:43.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:50:43.411 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-11-21T05:50:43.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-21T05:50:43.686 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-348.2.1.el8_5.x86_64"... 2021-11-21T05:50:43.686 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-11-21T05:50:43.737 INFO:teuthology.orchestra.run.gibba038.stdout:4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:50:43.738 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-348.2.1.el8_5.x86_64 vs 4.18.0-348.2.1.el8_5.x86_64 2021-11-21T05:50:43.738 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-21T05:50:43.738 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-11-21T05:50:44.740 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-11-21T05:50:44.741 DEBUG:teuthology.orchestra.run.gibba038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-21T05:50:44.803 INFO:teuthology.orchestra.run.gibba038.stdout:ttyS1 2021-11-21T05:50:44.816 DEBUG:teuthology.parallel:result is None 2021-11-21T05:51:36.971 DEBUG:teuthology.orchestra.remote:timed out 2021-11-21T05:52:06.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba001.front.sepia.ceph.com' 2021-11-21T05:52:06.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:53:10.027 DEBUG:teuthology.orchestra.remote:timed out 2021-11-21T05:53:40.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba001.front.sepia.ceph.com' 2021-11-21T05:53:40.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:54:43.083 DEBUG:teuthology.orchestra.remote:timed out 2021-11-21T05:54:43.085 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-348.2.1.el8_5.x86_64"... 2021-11-21T05:54:43.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba001.front.sepia.ceph.com' 2021-11-21T05:54:43.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T05:55:46.155 DEBUG:teuthology.orchestra.remote:timed out 2021-11-21T05:55:46.156 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 709, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 186, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/run.py", line 438, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to gibba001 was lost: 'uname -r' 2021-11-21T05:55:46.158 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 1235, in task p.spawn(process_role, ctx, config, timeout, role, role_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 1332, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 709, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 186, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/run.py", line 438, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to gibba001 was lost: 'uname -r' 2021-11-21T05:55:46.446 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3667de66ed424d0b9bcae956c38b5ad4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 1235, in task p.spawn(process_role, ctx, config, timeout, role, role_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 1332, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 709, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/task/kernel.py", line 186, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/run.py", line 438, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to gibba001 was lost: 'uname -r' 2021-11-21T05:55:46.454 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-11-21T05:55:46.542 INFO:teuthology.nuke:Checking targets against current locks 2021-11-21T05:55:46.684 DEBUG:teuthology.nuke:shortname: gibba001 2021-11-21T05:55:46.685 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-21T05:55:46.687 DEBUG:teuthology.nuke:shortname: gibba031 2021-11-21T05:55:46.687 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-21T05:55:46.688 DEBUG:teuthology.nuke:shortname: gibba038 2021-11-21T05:55:46.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-21T05:55:46.715 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 05:42:26.487777', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyN0Tvk+NjO9vIHuyyMmWF6i3DpO9jAsJoTGzx1p/hzrYb0QXH4UK6Il7BWrXetcyB5f4NrpH8QY8wH+S+4UzUZuWLmlYP7Wsynu0Usex1phqBQosRFRyuMFRXl0ef5I3gaVLqPfLgjUlauJnzkcA8IDB4X8mhY3UxlAztBoopFyN4zOFDgXi5LARm82A2ocbuSHELnkCZ+IDC3E+AMTR216/YBDdA5asuL6bIuhFrOUgBaGdK1iczDtiadiT73xZTQ5L9UxV5mvXsWjuY2ga5/4vpD53R6kKaMhBUTaQ3wDzERg7n3+RjR8qLHSRTNnOGdrQQtTYhJnUZrErUXHOPuNTDqvT8T+U/hgbdQsHDr3f1NWnJr2RDPkxYbdapvNz7A5MF0QQNygWC/xRTmNOvwPTJGLQvD+dWAQrGdtM73SbIRzrdcbzfP/S+CBC2zraa43/dStSA3L46o1VvJGHNlcFL4miJx9JjViPCmlvyByl0exUtht1oQCT7fvWH5gE='} 2021-11-21T05:55:46.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 05:42:26.490406', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpiqUwYkjm3oihYDh4sza4URXUPea6Hk622oNxbe6F6xgLcLVRr7uBS4xQQ/1EwkYqI9bV+cTrH9FNk+beHC1Z6OWseGWcnyJzGEPyXhY8UlG2LvSfaK0LLy2G3A7Dq7++nT20ZV3ZLiTJX2Gz9er0oTTcWxZixAQGP9e1KTAapCHumCNiOQ3haliKjL+P1gtk2MvjrFqNLAb8pstjV7+G3IVu06K7cNX/RqvTEaJ7eyYd7/KqJJ16nvJ2KSbsltgAdFXTh0c5k4fPCrvDeAaw1+oy6lpyywdEuaAgcVqD+zpuYH/hzBNdlTerx92W68D7lnyxDUUT5xibnSd47Kr6qG9eznr/1oR+1Nd0EcowvRT+zUfZQ8ZfzCd7BKcOBXM+ttnqTZCgToUkQbu0FoDyRutmbmITpfanCEFoWQoFWPE6JvkD4UNu3TWZ5aMq/MXLS0AsxwmXSBHCs4asaqy+u9UIzqRHFMPlMFvS0Vh5TjWmaDpXbwUeMzhEzVtMbks='} 2021-11-21T05:55:46.721 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-21_05:00:03-smoke-master-distro-default-gibba/6517888', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 05:42:26.489225', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfcw4ikHXA0++lklaD+IGGwQiU2MP+nnc7h/fuJC+MKOO0fqi12FjT4qrbPc52eKcw3C3NwhQC/eHpBJF1ZWJCmo6dducU9emWCpum2Sf8HFCMWI98v9JdviKz+BlBdnQY9OyLeL7ICFIXBMDwgawyBkCe5j+LhgXPPXdLX52pFJAOuKLoiY7jtd36yVbhdTF1PT9SZDREzx2RxFvW8hYDHvXjDFnSsmOHykaZfigjU1PN8iI4pEG1GZ6MJMT2WOFfT8XLMpFpbFwO46DCOyeMaS0mSA1e3JG9cBBIyqQ+HS+O+Ytb8n4xkojSShQaEotjqeqqcNG+WxQFq70n+pYD2kvBBuaMYYJmiiDffGSLqn4CqPbvmHqtoylserwgXK3z2n63nqYKo/UGJd5izllVcTKdcjiLyeKoseblBW2O4TcYeyIopvlnIWzOrTSn1eFjMYmWwR0oILwcXi6IVAUZgX1VZDktRB14nG9k1BJYuKB6F4JRWr4DA/lnpPCfau8='} 2021-11-21T05:55:46.778 INFO:teuthology.orchestra.console:Power off gibba038 2021-11-21T05:55:46.779 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-21T05:55:46.798 INFO:teuthology.orchestra.console:Power off gibba031 2021-11-21T05:55:46.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-21T05:55:46.813 INFO:teuthology.orchestra.console:Power off gibba001 2021-11-21T05:55:46.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-21T05:55:46.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:46.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:46.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:50.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:50.863 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:50.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:54.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:54.983 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:55.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:55.186 INFO:teuthology.orchestra.console:Power off for gibba038 completed 2021-11-21T05:55:55.193 INFO:teuthology.orchestra.console:Power off for gibba031 completed 2021-11-21T05:55:59.186 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-21T05:55:59.397 INFO:teuthology.orchestra.console:Power off for gibba001 completed 2021-11-21T05:55:59.502 INFO:teuthology.run:Summary data: description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/libcephfs_interface_tests}} failure_reason: 'SSH connection to gibba001 was lost: ''uname -r''' owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3667de66ed424d0b9bcae956c38b5ad4 status: dead success: false 2021-11-21T05:55:59.502 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-21T05:55:59.568 INFO:teuthology.run:DEAD