2021-03-30T05:03:00.092 INFO:root:teuthology version: 1.1.0-9870012c 2021-03-30T05:03:00.096 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} --verbose --archive /home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011068 --name sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi --owner scheduled_sage@teuthology -- /home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011068/orig.config.yaml 2021-03-30T05:03:00.137 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-30T05:03:00.209 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011068 branch: wip-sage4-testing-2021-03-29-2018-octopus description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} email: null first_in_suite: false job_id: '6011068' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-sage4-testing-2021-03-29-2018-octopus ceph: conf: global: mon client directed command retry: 5 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 2 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd initial require min compat client: jewel mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd inject bad map crc probability: 0.1 osd max markdown count: 1000 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true crush_tunables: jewel fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: e4949d651265114d7b464cd1e8986d9a31a26071 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: e4949d651265114d7b464cd1e8986d9a31a26071 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage4-testing-2021-03-29-2018-octopus sha1: e4949d651265114d7b464cd1e8986d9a31a26071 owner: scheduled_sage@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: e4949d651265114d7b464cd1e8986d9a31a26071 sleep_before_teardown: 0 suite: rados suite_branch: wip-sage4-testing-2021-03-29-2018-octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e4949d651265114d7b464cd1e8986d9a31a26071/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: e4949d651265114d7b464cd1e8986d9a31a26071 targets: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCresPfUl8mQU07AWQX5qXWDVeUmsOC8EffNacLwBmlcQudyssaeU8GqBmEUltUx246hsC7DOvZHIRSkB1d6ZpOM8wO/KyfptuFWIz47mnQtNGTsJoNi02GvT2cM+AzMdD3bIFsfN5jqeDyejYg8+PPheicZBdsEvg0cvt6RP8gf5j6N0lUFi6WQoUtQriIBsuO4HIwKsHR96Vcon6aFvFNCsdGTwUkurS/TFYwg0qgh8mNwy09doYwE0EyTs1wH8RNh0J5fFUs2SiO2kUaCokA4ylB7Si60+AoYeASPxlzshifmAZgg1TNjULWAAHBdyu22Lsbu6NGIcbny968dQ6rRBzPJflf73DNx5FpAjJsi+drffpvnp+oyMUl/7kWiKpBZlaNBWARualzXPQka+BXbxRXwL4ERCqr54C2sZKv2rS2NBInTkn1VhAKwtjAGv/mK90ndmXIxyxK5fkxz7DWJzhoAGtIfWnv1HvtyAuetZ3arK5TgLzTVC2YZu2WKkc= smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQls92cgQfJZCE9EH9kMbbJsf9LKIwXKfGg2FSnzy+v6kWdA0TCjmZvTEoJCcVyLPtOdbI7BmtLWRsYAcrdjP2254VldD/1/pPHjMZYJjk9D04LBQhaPbzb0D77wTx9tFEzE5NlXj1J8Zc5mRs8IKSRhhIr1iWhtUq3pSrX36MmxyFKf5vQU+6JfR8dtdPt/bz+7uBJaTN9qfcg98Rmm28RoBNXmEC3f34kp3wMwYbR/ipJh7XcxswjfC0vSAA/xI5K1koL3Xq0HMu9YFzxpj5lma4tTf/QeKPsJ33jmYFnTT2aNkzCTj+FHd0yxFv8jyrV4y5xrXcreYKyyUxeOzsBAjwJWpi2PWr+1216GffoZALuyRnaGycdril3Ua66l4658ySqEUsS9AWkknLQrp3c2ZDKwlaunQE+Ck/aq0lHC98ND7cc17IELeLeuQE9NGRgFniZiaGx88pHtB+TforzYTxVLL8SZ7Np+SI1Y8Vzhg9AytzsanDByc1pc8vDoM= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph osd set-require-min-compat-client luminous - ceph balancer mode upmap - ceph balancer on - rados: balance_reads: true clients: - client.0 max_in_flight: 64 max_seconds: 600 objects: 1024 op_weights: copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 100 ops: 400000 size: 16384 teuthology_branch: master teuthology_sha1: 9870012c9b43ad9e4e27984868ce0706e230f04f timestamp: 2021-03-30_02:52:08 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.16628 2021-03-30T05:03:00.210 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e4949d651265114d7b464cd1e8986d9a31a26071/qa; will attempt to use it 2021-03-30T05:03:00.217 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e4949d651265114d7b464cd1e8986d9a31a26071/qa/tasks 2021-03-30T05:03:00.218 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-30T05:03:00.220 INFO:teuthology.task.internal:Checking packages... 2021-03-30T05:03:00.297 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'e4949d651265114d7b464cd1e8986d9a31a26071' 2021-03-30T05:03:00.298 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-30T05:03:00.298 INFO:teuthology.packaging:ref: None 2021-03-30T05:03:00.299 INFO:teuthology.packaging:tag: None 2021-03-30T05:03:00.299 INFO:teuthology.packaging:branch: wip-sage4-testing-2021-03-29-2018-octopus 2021-03-30T05:03:00.299 INFO:teuthology.packaging:sha1: e4949d651265114d7b464cd1e8986d9a31a26071 2021-03-30T05:03:00.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-sage4-testing-2021-03-29-2018-octopus 2021-03-30T05:03:00.445 INFO:teuthology.task.internal:Found packages for ceph version 15.2.10-14.ge4949d65 2021-03-30T05:03:00.445 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-30T05:03:00.453 INFO:teuthology.task.internal:no buildpackages task found 2021-03-30T05:03:00.453 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-30T05:03:00.508 INFO:teuthology.task.internal:Saving configuration 2021-03-30T05:03:00.525 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-30T05:03:00.534 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-30T05:03:00.552 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-30 04:58:09.063693', 'description': '/home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011068', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBArzjExG52JXv168FdwJgtXZHk/Kp5BRDaQYeM5NAS29I7oxlQ2Ixvf8qs1kUFnqSMbW38+EoTMXTMI4m4g93vU=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi078.front.sepia.ceph.com'} 2021-03-30T05:03:00.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-30 04:58:09.063712', 'description': '/home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011068', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3XcyjZlJ5wgB1wRO5Ai0E3QJu2y7aBLlcl9jMvlVr8kWiTNYG7pGJbcee+7a+cU5hFf+iyIjCidZMXswjXvr4=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi184.front.sepia.ceph.com'} 2021-03-30T05:03:00.568 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-30T05:03:00.577 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-03-30T05:03:00.577 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-03-30T05:03:00.577 INFO:teuthology.run_tasks:Running task console_log... 2021-03-30T05:03:00.682 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4d287cf28>, signals=[15]) 2021-03-30T05:03:00.683 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-30T05:03:00.702 INFO:teuthology.task.internal:Opening connections... 2021-03-30T05:03:00.702 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2021-03-30T05:03:00.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T05:03:00.775 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2021-03-30T05:03:00.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T05:03:00.849 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-30T05:03:00.858 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2021-03-30T05:03:00.915 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2021-03-30T05:03:00.916 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2021-03-30T05:03:00.969 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Linux" 2021-03-30T05:03:00.970 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8 (Core)" 2021-03-30T05:03:00.970 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2021-03-30T05:03:00.970 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2021-03-30T05:03:00.970 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2021-03-30T05:03:00.971 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2021-03-30T05:03:00.971 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-03-30T05:03:00.971 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2021-03-30T05:03:00.972 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-30T05:03:00.972 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.centos.org/" 2021-03-30T05:03:00.972 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-30T05:03:00.972 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:03:00.972 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-30T05:03:00.973 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-30T05:03:00.973 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-03-30T05:03:00.973 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-03-30T05:03:00.973 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:03:00.974 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2021-03-30T05:03:00.990 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2021-03-30T05:03:01.006 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2021-03-30T05:03:01.006 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2021-03-30T05:03:01.060 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Linux" 2021-03-30T05:03:01.061 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8 (Core)" 2021-03-30T05:03:01.061 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2021-03-30T05:03:01.061 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2021-03-30T05:03:01.061 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2021-03-30T05:03:01.062 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2021-03-30T05:03:01.062 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-03-30T05:03:01.062 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2021-03-30T05:03:01.062 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-30T05:03:01.062 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.centos.org/" 2021-03-30T05:03:01.063 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-30T05:03:01.063 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:03:01.063 INFO:teuthology.orchestra.run.smithi184.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-30T05:03:01.064 INFO:teuthology.orchestra.run.smithi184.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-30T05:03:01.064 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-03-30T05:03:01.065 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-03-30T05:03:01.065 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:03:01.066 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2021-03-30T05:03:01.085 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-30T05:03:01.100 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-30T05:03:01.144 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-30T05:03:01.145 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2021-03-30T05:03:01.147 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2021-03-30T05:03:01.161 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-30T05:03:01.203 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-30T05:03:01.203 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2021-03-30T05:03:01.205 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2021-03-30T05:03:01.228 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-30T05:03:01.299 INFO:teuthology.run_tasks:Running task kernel... 2021-03-30T05:03:01.330 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-03-30T05:03:01.331 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-30T05:03:01.331 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2021-03-30T05:03:01.346 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-03-30T05:03:01.346 INFO:teuthology.task.kernel:Running kernel on smithi078: 4.18.0-240.10.1.el8_3.x86_64 2021-03-30T05:03:01.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2021-03-30T05:03:04.812 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - AppStream 35 MB/s | 6.3 MB 00:00 2021-03-30T05:03:05.897 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - Base 25 MB/s | 2.3 MB 00:00 2021-03-30T05:03:06.335 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - Extras 149 kB/s | 9.6 kB 00:00 2021-03-30T05:03:07.171 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 12 MB/s | 9.1 MB 00:00 2021-03-30T05:03:09.044 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-03-30T05:03:10.092 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2021-03-30T05:03:10.093 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-03-30T05:03:10.253 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2021-03-30T05:03:10.272 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2021-03-30T05:03:10.272 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2021-03-30T05:03:10.272 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2021-03-30T05:03:10.273 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2021-03-30T05:03:10.273 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 4.3 M 2021-03-30T05:03:10.273 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2021-03-30T05:03:10.274 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 30 M 2021-03-30T05:03:10.274 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 26 M 2021-03-30T05:03:10.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:03:10.275 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2021-03-30T05:03:10.275 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2021-03-30T05:03:10.275 INFO:teuthology.orchestra.run.smithi078.stdout:Install 3 Packages 2021-03-30T05:03:10.276 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:03:10.276 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 60 M 2021-03-30T05:03:10.276 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 83 M 2021-03-30T05:03:10.277 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2021-03-30T05:03:10.403 INFO:teuthology.orchestra.run.smithi078.stdout:(1/3): kernel-4.18.0-240.15.1.el8_3.x86_64.rpm 33 MB/s | 4.3 MB 00:00 2021-03-30T05:03:11.052 INFO:teuthology.orchestra.run.smithi078.stdout:(2/3): kernel-core-4.18.0-240.15.1.el8_3.x86_64 39 MB/s | 30 MB 00:00 2021-03-30T05:03:11.287 INFO:teuthology.orchestra.run.smithi078.stdout:(3/3): kernel-modules-4.18.0-240.15.1.el8_3.x86 25 MB/s | 26 MB 00:01 2021-03-30T05:03:11.290 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2021-03-30T05:03:11.290 INFO:teuthology.orchestra.run.smithi078.stdout:Total 59 MB/s | 60 MB 00:01 2021-03-30T05:03:11.376 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2021-03-30T05:03:11.673 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2021-03-30T05:03:11.673 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2021-03-30T05:03:12.738 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2021-03-30T05:03:12.741 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2021-03-30T05:03:15.052 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2021-03-30T05:03:15.758 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T05:03:18.352 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T05:03:18.716 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T05:03:21.595 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T05:03:21.793 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:03:44.078 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:03:44.336 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:03:44.336 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T05:03:44.336 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T05:03:44.628 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:03:44.629 INFO:teuthology.orchestra.run.smithi078.stdout:Installed products updated. 2021-03-30T05:03:44.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:03:44.931 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2021-03-30T05:03:44.932 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:03:44.932 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:03:44.932 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:03:44.932 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:03:44.932 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2021-03-30T05:03:45.007 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel --last | head -n 1 2021-03-30T05:03:45.139 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 05:03:21 AM UTC 2021-03-30T05:03:45.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:03:45.141 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:03:45.142 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2021-03-30T05:03:45.159 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-03-30T05:03:45.159 INFO:teuthology.task.kernel:Running kernel on smithi184: 4.18.0-240.10.1.el8_3.x86_64 2021-03-30T05:03:45.160 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2021-03-30T05:03:48.710 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-8 - AppStream 35 MB/s | 6.3 MB 00:00 2021-03-30T05:03:49.794 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-8 - Base 26 MB/s | 2.3 MB 00:00 2021-03-30T05:03:50.262 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-8 - Extras 126 kB/s | 9.6 kB 00:00 2021-03-30T05:03:50.947 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 14 MB/s | 9.1 MB 00:00 2021-03-30T05:03:52.838 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-03-30T05:03:53.931 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2021-03-30T05:03:53.932 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-03-30T05:03:54.094 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2021-03-30T05:03:54.107 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2021-03-30T05:03:54.107 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2021-03-30T05:03:54.108 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2021-03-30T05:03:54.108 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2021-03-30T05:03:54.108 INFO:teuthology.orchestra.run.smithi184.stdout: kernel x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 4.3 M 2021-03-30T05:03:54.108 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2021-03-30T05:03:54.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 30 M 2021-03-30T05:03:54.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 26 M 2021-03-30T05:03:54.109 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:03:54.109 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2021-03-30T05:03:54.110 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2021-03-30T05:03:54.110 INFO:teuthology.orchestra.run.smithi184.stdout:Install 3 Packages 2021-03-30T05:03:54.110 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:03:54.111 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 60 M 2021-03-30T05:03:54.111 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 83 M 2021-03-30T05:03:54.111 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2021-03-30T05:03:54.285 INFO:teuthology.orchestra.run.smithi184.stdout:(1/3): kernel-4.18.0-240.15.1.el8_3.x86_64.rpm 25 MB/s | 4.3 MB 00:00 2021-03-30T05:03:55.456 INFO:teuthology.orchestra.run.smithi184.stdout:(2/3): kernel-core-4.18.0-240.15.1.el8_3.x86_64 23 MB/s | 30 MB 00:01 2021-03-30T05:03:55.650 INFO:teuthology.orchestra.run.smithi184.stdout:(3/3): kernel-modules-4.18.0-240.15.1.el8_3.x86 17 MB/s | 26 MB 00:01 2021-03-30T05:03:55.653 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2021-03-30T05:03:55.653 INFO:teuthology.orchestra.run.smithi184.stdout:Total 39 MB/s | 60 MB 00:01 2021-03-30T05:03:55.739 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2021-03-30T05:03:56.030 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2021-03-30T05:03:56.031 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2021-03-30T05:03:57.085 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2021-03-30T05:03:57.088 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2021-03-30T05:03:59.288 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2021-03-30T05:03:59.912 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T05:04:02.515 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T05:04:02.811 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T05:04:05.687 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T05:04:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:04:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:04:28.419 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:04:28.419 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T05:04:28.419 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-core-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T05:04:28.699 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T05:04:28.699 INFO:teuthology.orchestra.run.smithi184.stdout:Installed products updated. 2021-03-30T05:04:29.053 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:04:29.053 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2021-03-30T05:04:29.053 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:29.054 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:29.054 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:29.054 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:04:29.054 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2021-03-30T05:04:29.127 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel --last | head -n 1 2021-03-30T05:04:29.239 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 05:04:05 AM UTC 2021-03-30T05:04:29.240 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:29.241 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:29.241 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-03-30T05:04:29.241 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-03-30T05:04:29.241 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-03-30T05:04:29.242 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-03-30T05:04:29.242 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2021-03-30T05:04:29.243 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel --last | head -n 1 2021-03-30T05:04:29.341 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 05:03:21 AM UTC 2021-03-30T05:04:29.342 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:29.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2021-03-30T05:04:29.377 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2021-03-30T05:04:29.377 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2021-03-30T05:04:29.377 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.02 2021-03-30T05:04:29.377 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 78.el8 2021-03-30T05:04:29.378 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2021-03-30T05:04:29.378 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Sun 28 Feb 2021 12:07:24 PM UTC 2021-03-30T05:04:29.378 INFO:teuthology.orchestra.run.smithi078.stdout:Group : System Environment/Base 2021-03-30T05:04:29.379 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 9192691 2021-03-30T05:04:29.379 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2021-03-30T05:04:29.379 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2021-03-30T05:04:29.379 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2021-03-30T05:04:29.379 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2021-03-30T05:04:29.380 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : kbuilder.bsys.centos.org 2021-03-30T05:04:29.380 INFO:teuthology.orchestra.run.smithi078.stdout:Relocations : (not relocatable) 2021-03-30T05:04:29.380 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : CentOS BuildSystem 2021-03-30T05:04:29.380 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2021-03-30T05:04:29.380 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2021-03-30T05:04:29.381 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2021-03-30T05:04:29.381 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2021-03-30T05:04:29.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:04:29.381 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-03-30T05:04:29.382 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2021-03-30T05:04:29.382 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2021-03-30T05:04:29.382 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2021-03-30T05:04:29.382 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-03-30T05:04:29.382 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2021-03-30T05:04:29.383 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-03-30T05:04:29.384 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:29.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-03-30T05:04:30.196 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2021-03-30T05:04:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:done 2021-03-30T05:04:32.273 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2021-03-30T05:04:32.298 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.JhhLY9Av77 2021-03-30T05:04:32.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JhhLY9Av77 2021-03-30T05:04:32.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.JhhLY9Av77 2021-03-30T05:04:32.493 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.JhhLY9Av77 is 4KB 2021-03-30T05:04:32.542 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.JhhLY9Av77 2021-03-30T05:04:32.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2021-03-30T05:04:32.637 INFO:teuthology.orchestra.run.smithi078.stdout:6f619c02a7094836b05d959b097bb5e7-0-rescue.conf 2021-03-30T05:04:32.638 INFO:teuthology.orchestra.run.smithi078.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-147.el8.x86_64.conf 2021-03-30T05:04:32.638 INFO:teuthology.orchestra.run.smithi078.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.10.1.el8_3.x86_64.conf 2021-03-30T05:04:32.638 INFO:teuthology.orchestra.run.smithi078.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64.conf 2021-03-30T05:04:32.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default 6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:32.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2021-03-30T05:04:32.810 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-03-30T05:04:32.811 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2021-03-30T05:04:32.811 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel --last | head -n 1 2021-03-30T05:04:32.910 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 05:04:05 AM UTC 2021-03-30T05:04:32.912 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:32.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2021-03-30T05:04:32.946 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2021-03-30T05:04:32.946 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2021-03-30T05:04:32.947 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.02 2021-03-30T05:04:32.947 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 78.el8 2021-03-30T05:04:32.947 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2021-03-30T05:04:32.947 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Sun 28 Feb 2021 12:07:24 PM UTC 2021-03-30T05:04:32.948 INFO:teuthology.orchestra.run.smithi184.stdout:Group : System Environment/Base 2021-03-30T05:04:32.948 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 9192691 2021-03-30T05:04:32.949 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2021-03-30T05:04:32.949 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2021-03-30T05:04:32.949 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2021-03-30T05:04:32.950 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2021-03-30T05:04:32.950 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : kbuilder.bsys.centos.org 2021-03-30T05:04:32.951 INFO:teuthology.orchestra.run.smithi184.stdout:Relocations : (not relocatable) 2021-03-30T05:04:32.951 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : CentOS BuildSystem 2021-03-30T05:04:32.952 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2021-03-30T05:04:32.952 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2021-03-30T05:04:32.952 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2021-03-30T05:04:32.953 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2021-03-30T05:04:32.953 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:04:32.954 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-03-30T05:04:32.954 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2021-03-30T05:04:32.954 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2021-03-30T05:04:32.955 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2021-03-30T05:04:32.955 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-03-30T05:04:32.956 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2021-03-30T05:04:32.957 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-03-30T05:04:32.958 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:32.959 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-03-30T05:04:34.404 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2021-03-30T05:04:36.110 INFO:teuthology.orchestra.run.smithi184.stderr:done 2021-03-30T05:04:36.111 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2021-03-30T05:04:36.142 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.1HQxMRm3qJ 2021-03-30T05:04:36.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1HQxMRm3qJ 2021-03-30T05:04:36.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.1HQxMRm3qJ 2021-03-30T05:04:36.373 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.1HQxMRm3qJ is 4KB 2021-03-30T05:04:36.421 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.1HQxMRm3qJ 2021-03-30T05:04:36.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2021-03-30T05:04:36.501 INFO:teuthology.orchestra.run.smithi184.stdout:6f619c02a7094836b05d959b097bb5e7-0-rescue.conf 2021-03-30T05:04:36.501 INFO:teuthology.orchestra.run.smithi184.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-147.el8.x86_64.conf 2021-03-30T05:04:36.501 INFO:teuthology.orchestra.run.smithi184.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.10.1.el8_3.x86_64.conf 2021-03-30T05:04:36.501 INFO:teuthology.orchestra.run.smithi184.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64.conf 2021-03-30T05:04:36.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default 6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:04:36.641 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2021-03-30T05:05:06.673 INFO:teuthology.misc:Re-opening connections... 2021-03-30T05:05:06.676 INFO:teuthology.misc:trying to connect to ubuntu@smithi078.front.sepia.ceph.com 2021-03-30T05:05:06.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T05:05:06.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T05:05:25.127 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2021-03-30T05:05:25.134 INFO:teuthology.misc:trying to connect to ubuntu@smithi184.front.sepia.ceph.com 2021-03-30T05:05:25.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T05:05:25.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T05:06:25.195 DEBUG:teuthology.orchestra.remote:timed out 2021-03-30T05:06:25.205 DEBUG:teuthology.misc:waited 78.52976942062378 2021-03-30T05:06:26.207 INFO:teuthology.misc:trying to connect to ubuntu@smithi078.front.sepia.ceph.com 2021-03-30T05:06:26.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T05:06:26.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T05:06:26.498 DEBUG:teuthology.orchestra.run.smithi078:> true 2021-03-30T05:06:26.846 DEBUG:teuthology.misc:waited 80.17081212997437 2021-03-30T05:06:27.848 INFO:teuthology.misc:trying to connect to ubuntu@smithi184.front.sepia.ceph.com 2021-03-30T05:06:27.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T05:06:27.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T05:06:28.126 DEBUG:teuthology.orchestra.run.smithi184:> true 2021-03-30T05:06:28.509 DEBUG:teuthology.misc:waited 81.83293461799622 2021-03-30T05:06:29.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-03-30T05:06:29.510 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-240.15.1.el8_3.x86_64"... 2021-03-30T05:06:29.511 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2021-03-30T05:06:29.528 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:06:29.528 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.15.1.el8_3.x86_64 vs 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:06:29.529 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-03-30T05:06:29.529 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-03-30T05:06:29.529 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-03-30T05:06:29.529 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-240.15.1.el8_3.x86_64"... 2021-03-30T05:06:29.530 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2021-03-30T05:06:29.547 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:06:29.547 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.15.1.el8_3.x86_64 vs 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T05:06:29.547 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-03-30T05:06:29.548 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-03-30T05:06:30.548 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-30T05:06:30.549 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-30T05:06:30.628 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2021-03-30T05:06:30.640 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-03-30T05:06:30.640 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-30T05:06:30.720 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2021-03-30T05:06:30.732 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-30T05:06:30.741 INFO:teuthology.task.internal:Creating test directory... 2021-03-30T05:06:30.743 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-30T05:06:30.747 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-30T05:06:30.766 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-30T05:06:30.782 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-30T05:06:30.813 INFO:teuthology.task.internal:Creating archive directory... 2021-03-30T05:06:30.813 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-30T05:06:30.816 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive