2020-06-12T02:32:50.048 INFO:root:teuthology version: 1.0.0-6c966fe 2020-06-12T02:32:50.051 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} --verbose --owner scheduled_kchai@teuthology --block --archive /home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138064 --lock --name kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi -- /tmp/teuthology-worker.5b95q75t.tmp 2020-06-12T02:32:50.099 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T02:32:50.171 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138064 branch: octopus description: rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} email: tchaikov@gmail.com first_in_suite: false job_id: '5138064' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: centos os_version: '7.6' overrides: admin_socket: branch: octopus ceph: conf: client.2: debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd debug verify cached snaps: true osd debug verify missing on start: true osd max markdown count: 1000 osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: min_in: 4 workunit: branch: octopus-py3 sha1: 1e0d5d60071d5554f87a2be72ea0bcccb272aab3 owner: scheduled_kchai@teuthology priority: 90 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 sleep_before_teardown: 0 suite: rados suite_branch: octopus-py3 suite_path: /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa suite_relpath: qa suite_repo: https://github.com/tchaikov/ceph.git suite_sha1: 1e0d5d60071d5554f87a2be72ea0bcccb272aab3 tasks: - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs - cephadm: null - full_sequential: - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.27827 2020-06-12T02:32:50.171 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa; will attempt to use it 2020-06-12T02:32:50.172 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks 2020-06-12T02:32:50.173 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-06-12T02:32:50.175 INFO:teuthology.task.internal:Checking packages... 2020-06-12T02:32:50.201 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '91d24f498556f86f6d1318d2efd5210c35b36762' 2020-06-12T02:32:50.202 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-06-12T02:32:50.202 INFO:teuthology.packaging:ref: None 2020-06-12T02:32:50.203 INFO:teuthology.packaging:tag: None 2020-06-12T02:32:50.203 INFO:teuthology.packaging:branch: octopus 2020-06-12T02:32:50.203 INFO:teuthology.packaging:sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T02:32:50.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=octopus 2020-06-12T02:32:50.636 INFO:teuthology.task.internal:Found packages for ceph version 15.2.3-298.g7488806bf1 2020-06-12T02:32:50.637 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-06-12T02:32:50.645 INFO:teuthology.task.internal:no buildpackages task found 2020-06-12T02:32:50.645 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-06-12T02:32:50.665 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-06-12T02:32:50.666 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T02:32:50.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-06-12T02:33:00.743 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-06-12T02:33:10.773 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-06-12T02:33:20.794 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138064'} 2020-06-12T02:33:20.820 DEBUG:teuthology.lock.ops:locked ubuntu@smithi124.front.sepia.ceph.com, ubuntu@smithi093.front.sepia.ceph.com, ubuntu@smithi171.front.sepia.ceph.com 2020-06-12T02:33:21.374 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5eb66d6a8>, signals=[15]) 2020-06-12T02:33:21.627 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 7.6 2020-06-12T02:33:21.631 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 7.6 2020-06-12T02:33:21.642 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 7.6 2020-06-12T02:33:22.048 INFO:teuthology.orchestra.console:Power off smithi124 2020-06-12T02:33:22.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-12T02:33:22.079 INFO:teuthology.orchestra.console:Power off smithi093 2020-06-12T02:33:22.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-12T02:33:22.107 INFO:teuthology.orchestra.console:Power off smithi171 2020-06-12T02:33:22.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-12T02:33:22.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:22.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:22.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:26.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:26.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:26.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:30.279 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:30.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:30.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:34.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:34.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:34.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:34.622 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2020-06-12T02:33:34.654 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2020-06-12T02:33:34.676 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2020-06-12T02:33:34.723 INFO:teuthology.orchestra.console:Power on smithi093 2020-06-12T02:33:34.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-12T02:33:34.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:34.765 INFO:teuthology.orchestra.console:Power on smithi124 2020-06-12T02:33:34.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-12T02:33:34.784 INFO:teuthology.orchestra.console:Power on smithi171 2020-06-12T02:33:34.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-12T02:33:34.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:34.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:38.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:38.837 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:38.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:39.062 INFO:teuthology.orchestra.console:Power on for smithi124 completed 2020-06-12T02:33:39.071 INFO:teuthology.orchestra.console:Power on for smithi171 completed 2020-06-12T02:33:39.166 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2020-06-12T02:33:39.175 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2020-06-12T02:33:42.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:33:43.149 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2020-06-12T02:33:43.250 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2020-06-12T02:36:10.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:14.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:19.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:23.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:25.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:28.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:32.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:34.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:37.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:41.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:43.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:46.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:50.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:52.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:55.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:36:59.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:01.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:04.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:08.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:10.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:13.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:20.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:29.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:37:45.909 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-12T02:37:45.912 INFO:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-12T02:38:06.120 INFO:teuthology.provision.fog.smithi124:Node is ready 2020-06-12T02:38:06.121 INFO:teuthology.orchestra.run.smithi124:> hostname 2020-06-12T02:38:06.245 INFO:teuthology.orchestra.run.smithi124.stdout:smithi125 2020-06-12T02:38:06.247 INFO:teuthology.orchestra.run.smithi124:> grep smithi125 /etc/hosts 2020-06-12T02:38:06.318 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2020-06-12T02:38:06.319 INFO:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2020-06-12T02:38:06.487 INFO:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi125/smithi124/g' /etc/hosts 2020-06-12T02:38:06.582 INFO:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.125/172.21.15.124/g' /etc/hosts 2020-06-12T02:38:06.655 INFO:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi125/smithi124/g' /etc/hostname 2020-06-12T02:38:06.724 INFO:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2020-06-12T02:38:06.793 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2020-06-12T02:38:06.794 DEBUG:teuthology.parallel:result is None 2020-06-12T02:38:14.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:15.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-12T02:38:15.137 INFO:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-12T02:38:15.641 INFO:teuthology.provision.fog.smithi093:Node is ready 2020-06-12T02:38:15.641 INFO:teuthology.orchestra.run.smithi093:> hostname 2020-06-12T02:38:15.726 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2020-06-12T02:38:15.726 INFO:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2020-06-12T02:38:15.801 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2020-06-12T02:38:15.802 INFO:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2020-06-12T02:38:15.949 INFO:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2020-06-12T02:38:16.046 INFO:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2020-06-12T02:38:16.130 INFO:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2020-06-12T02:38:16.205 INFO:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2020-06-12T02:38:16.269 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2020-06-12T02:38:16.270 DEBUG:teuthology.parallel:result is None 2020-06-12T02:38:35.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:35.396 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-12T02:38:35.397 INFO:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-12T02:38:35.947 INFO:teuthology.provision.fog.smithi171:Node is ready 2020-06-12T02:38:35.947 INFO:teuthology.orchestra.run.smithi171:> hostname 2020-06-12T02:38:36.041 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171 2020-06-12T02:38:36.042 INFO:teuthology.orchestra.run.smithi171:> grep smithi171 /etc/hosts 2020-06-12T02:38:36.118 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2020-06-12T02:38:36.119 INFO:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2020-06-12T02:38:36.271 INFO:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171/smithi171/g' /etc/hosts 2020-06-12T02:38:36.384 INFO:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts 2020-06-12T02:38:36.484 INFO:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171/smithi171/g' /etc/hostname 2020-06-12T02:38:36.566 INFO:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2020-06-12T02:38:36.646 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2020-06-12T02:38:36.647 DEBUG:teuthology.parallel:result is None 2020-06-12T02:38:36.873 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2020-06-12T02:38:36.875 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-12T02:38:36.901 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2020-06-12T02:38:36.901 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-12T02:38:36.926 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com 2020-06-12T02:38:36.927 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-12T02:38:36.953 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2020-06-12T02:38:36.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:38:36.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:37.072 INFO:teuthology.orchestra.run.smithi124:> true 2020-06-12T02:38:37.439 INFO:teuthology.orchestra.run.smithi124:> uname -m 2020-06-12T02:38:37.501 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2020-06-12T02:38:37.502 INFO:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Linux" 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="7 (Core)" 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="7" 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.centos.org/" 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:37.585 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2020-06-12T02:38:37.610 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2020-06-12T02:38:37.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:38:37.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:37.716 INFO:teuthology.orchestra.run.smithi093:> true 2020-06-12T02:38:38.093 INFO:teuthology.orchestra.run.smithi093:> uname -m 2020-06-12T02:38:38.161 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2020-06-12T02:38:38.162 INFO:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2020-06-12T02:38:38.218 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Linux" 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="7 (Core)" 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="7" 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.centos.org/" 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi093.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi093.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-06-12T02:38:38.222 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2020-06-12T02:38:38.246 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server 2020-06-12T02:38:38.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:38:38.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:38.348 INFO:teuthology.orchestra.run.smithi171:> true 2020-06-12T02:38:38.752 INFO:teuthology.orchestra.run.smithi171:> uname -m 2020-06-12T02:38:38.835 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2020-06-12T02:38:38.836 INFO:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2020-06-12T02:38:38.923 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Linux" 2020-06-12T02:38:38.923 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="7 (Core)" 2020-06-12T02:38:38.923 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="7" 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.centos.org/" 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi171.stdout: 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi171.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi171.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-06-12T02:38:38.926 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-12T02:38:38.926 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-06-12T02:38:38.927 INFO:teuthology.orchestra.run.smithi171.stdout: 2020-06-12T02:38:38.928 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2020-06-12T02:38:38.957 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-06-12T02:38:39.007 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXBsg47PP49mONUMs7JQ39DUu2QjUHOqOpvgNYQx3Y7w/BX6q0f8jh/J+N2G62jKhyDPbgkphV9HoqIEF8ld+OuNIBZhkC0c47HEtRceVOu7tYXzUU1ag0xPJxQVC/8+wsozLv3RLFKTwyeUg6XLoKQ45PerfFGGOWyxnVzcE7n8Y6snIcMKIyiq4LHQ0k87/g7ngYIb+Qs5pCJMrBAQYHhY61JOvgiJXBW42s22vgOFaF9bvj96akI4+IxhJ1yQNN5AoGNPvmRgOPIOW0tRurXRM6vlgMqg/MzDXleA7FmRvDhXdkJQw57++AT3W8ydWf19oYMosqDJIJ7ikGgnPx smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVERC8grJP2NW3H9FjEy043H28D8ACkz1IJt4t7YrO/FNfosH8PtuSbQk4TAttJKV2f3F/yBJoXJpXi6xm8ZiJzFwrUGOwHOHPWf/Z/6j2uwVGE9bR2tVMuXm9CGy9GY33OfxZKT05fi3MH+PBzMZV3029crtDPFdOk/5C5sTVtS5VyOxADzBX7ArLe9c4fH79EhGO/OThIHf82M5sGbWOAzO6XmNhzlhROuMPnWBZW0d1InLfaW6WQMY/zVFPNjeSedCj5gQpoDcsSRCg63wCpj/CvWtadlox+dOhcff6/iTpIqbBW8wb9WE1xiHP91RkSr1aUjcbS0C5TYPNmp0p smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFlXyMPAsBnu0+IIYsyJVrgsUVliCh0gahYqzduNG+KafRXjA00m+UYctxJK4JVZQda2zuPUcPj2LiFy/lR8vCU6vnD/tICKgriV9ebTeAOrgIYqMZNWxpAGxr5XW7qzbeJrn4nLlG5oxlwOid79ZQX8uQcXK9PRnA9CA+Fc0rElZNUTeYfPcrMm+sOiG86rwBgmp41UQiyhn92utQgrn51OMF00HGs7MYTykAl0JzRqdOwSwNZILbYsk7OsSBMaTkhouOL36O+8wZWqQwVb97kW/2tO3HrbxxBFzOY6iYnVk4kdMtbTYz85g3qUj5pbND59aKWTOU2OyBMydox7z7 2020-06-12T02:38:39.008 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T02:38:39.082 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-06-12T02:38:39.110 INFO:teuthology.task.internal:Saving configuration 2020-06-12T02:38:39.132 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-06-12T02:38:39.147 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-06-12T02:38:39.163 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-12 02:33:20.801040', 'description': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138064', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKcI7QoLuGqcE3vY9s0ccflYbznsau1rD8UASDY392iDXx9gv63egx/1xNb9SDRADGAsGoc95SvtwrzNsB/7RBM=', 'os_version': '7', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi124.front.sepia.ceph.com'} 2020-06-12T02:38:39.180 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-12 02:33:20.801062', 'description': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138064', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB1ByR84oXO6UT5aZ/BRmbHtT78f/HEzu6TT4LluuC18tv1aX2+FXD81GYTzifeHN5FKHV+V6jGjlRRAXBqQEcg=', 'os_version': '7', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi093.front.sepia.ceph.com'} 2020-06-12T02:38:39.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-12 02:33:20.801078', 'description': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138064', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2u1urWB4N36A6LHN0r7wuXo1IM/6jxAbyruFryiLd67+o6w9DzkW7/khmzBP8RKfBCuizeACQuzbMtWj7ePoE=', 'os_version': '7', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi171.front.sepia.ceph.com'} 2020-06-12T02:38:39.200 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-06-12T02:38:39.219 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-06-12T02:38:39.219 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2020-06-12T02:38:39.219 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2020-06-12T02:38:39.220 INFO:teuthology.run_tasks:Running task console_log... 2020-06-12T02:38:39.354 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5eaf9bc80>, signals=[15]) 2020-06-12T02:38:39.355 INFO:teuthology.run_tasks:Running task internal.connect... 2020-06-12T02:38:39.372 INFO:teuthology.task.internal:Opening connections... 2020-06-12T02:38:39.378 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2020-06-12T02:38:39.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:39.496 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2020-06-12T02:38:39.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:39.610 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2020-06-12T02:38:39.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:38:39.715 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-06-12T02:38:39.725 INFO:teuthology.orchestra.run.smithi124:> uname -m 2020-06-12T02:38:39.798 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2020-06-12T02:38:39.799 INFO:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2020-06-12T02:38:39.849 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Linux" 2020-06-12T02:38:39.850 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="7 (Core)" 2020-06-12T02:38:39.850 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2020-06-12T02:38:39.850 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2020-06-12T02:38:39.850 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="7" 2020-06-12T02:38:39.850 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-06-12T02:38:39.851 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2020-06-12T02:38:39.851 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-06-12T02:38:39.851 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.centos.org/" 2020-06-12T02:38:39.851 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-12T02:38:39.851 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:39.852 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-06-12T02:38:39.852 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-06-12T02:38:39.852 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-12T02:38:39.852 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-06-12T02:38:39.852 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:39.853 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2020-06-12T02:38:39.876 INFO:teuthology.orchestra.run.smithi093:> uname -m 2020-06-12T02:38:39.994 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2020-06-12T02:38:39.995 INFO:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2020-06-12T02:38:40.062 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Linux" 2020-06-12T02:38:40.062 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="7 (Core)" 2020-06-12T02:38:40.063 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2020-06-12T02:38:40.063 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2020-06-12T02:38:40.063 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="7" 2020-06-12T02:38:40.063 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-06-12T02:38:40.064 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2020-06-12T02:38:40.064 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-06-12T02:38:40.064 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.centos.org/" 2020-06-12T02:38:40.064 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-12T02:38:40.064 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-06-12T02:38:40.065 INFO:teuthology.orchestra.run.smithi093.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-06-12T02:38:40.065 INFO:teuthology.orchestra.run.smithi093.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-06-12T02:38:40.065 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-12T02:38:40.065 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-06-12T02:38:40.065 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-06-12T02:38:40.066 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2020-06-12T02:38:40.088 INFO:teuthology.orchestra.run.smithi171:> uname -m 2020-06-12T02:38:40.230 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2020-06-12T02:38:40.230 INFO:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2020-06-12T02:38:40.315 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Linux" 2020-06-12T02:38:40.316 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="7 (Core)" 2020-06-12T02:38:40.316 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2020-06-12T02:38:40.316 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2020-06-12T02:38:40.316 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="7" 2020-06-12T02:38:40.317 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-06-12T02:38:40.317 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2020-06-12T02:38:40.317 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-06-12T02:38:40.317 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.centos.org/" 2020-06-12T02:38:40.317 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-12T02:38:40.317 INFO:teuthology.orchestra.run.smithi171.stdout: 2020-06-12T02:38:40.318 INFO:teuthology.orchestra.run.smithi171.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-06-12T02:38:40.318 INFO:teuthology.orchestra.run.smithi171.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-06-12T02:38:40.318 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-12T02:38:40.318 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-06-12T02:38:40.318 INFO:teuthology.orchestra.run.smithi171.stdout: 2020-06-12T02:38:40.319 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2020-06-12T02:38:40.339 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-06-12T02:38:40.357 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-06-12T02:38:40.366 INFO:teuthology.task.internal:Checking for old test directory... 2020-06-12T02:38:40.367 INFO:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2020-06-12T02:38:40.372 INFO:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2020-06-12T02:38:40.376 INFO:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2020-06-12T02:38:40.461 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-06-12T02:38:40.470 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-06-12T02:38:40.471 INFO:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2020-06-12T02:38:40.475 INFO:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2020-06-12T02:38:40.478 INFO:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2020-06-12T02:38:40.587 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-06-12T02:38:40.672 INFO:teuthology.run_tasks:Running task kernel... 2020-06-12T02:38:40.701 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'osd.8': {'kdb': True, 'sha1': 'distro'}, 'osd.9': {'kdb': True, 'sha1': 'distro'}, 'osd.10': {'kdb': True, 'sha1': 'distro'}, 'osd.11': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}} 2020-06-12T02:38:40.702 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-06-12T02:38:40.703 INFO:teuthology.orchestra.run.smithi124:> uname -r 2020-06-12T02:38:40.795 INFO:teuthology.orchestra.run.smithi124.stdout:3.10.0-1062.12.1.el7.x86_64 2020-06-12T02:38:40.796 INFO:teuthology.task.kernel:Running kernel on smithi124: 3.10.0-1062.12.1.el7.x86_64 2020-06-12T02:38:40.796 INFO:teuthology.orchestra.run.smithi124:> sudo yum install -y kernel 2020-06-12T02:38:41.748 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2020-06-12T02:38:41.857 INFO:teuthology.orchestra.run.smithi124.stdout:Determining fastest mirrors 2020-06-12T02:38:42.564 INFO:teuthology.orchestra.run.smithi124.stdout: * base: mirror.ash.fastserv.com 2020-06-12T02:38:42.581 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2020-06-12T02:38:42.582 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.linux.duke.edu 2020-06-12T02:38:42.582 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.centos.iad1.serverforge.org 2020-06-12T02:38:43.058 INFO:teuthology.orchestra.run.smithi124.stderr:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/d5878b2303a956252ef99e4adad6e29b07b8295b9346847e214510199f924514-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi124.stderr:Trying other mirror. 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi124.stderr:To address this issue please refer to the below wiki article 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi124.stderr: 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi124.stderr:https://wiki.centos.org/yum-errors 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi124.stderr: 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi124.stderr:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi124.stderr: 2020-06-12T02:38:46.789 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2020-06-12T02:38:46.790 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2020-06-12T02:38:46.790 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package kernel.x86_64 0:3.10.0-1127.10.1.el7 will be installed 2020-06-12T02:38:48.032 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2020-06-12T02:38:48.948 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:48.948 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2020-06-12T02:38:48.949 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:48.950 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2020-06-12T02:38:48.950 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2020-06-12T02:38:48.950 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2020-06-12T02:38:48.950 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2020-06-12T02:38:48.950 INFO:teuthology.orchestra.run.smithi124.stdout: kernel x86_64 3.10.0-1127.10.1.el7 updates 50 M 2020-06-12T02:38:48.951 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:48.951 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2020-06-12T02:38:48.951 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2020-06-12T02:38:48.951 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2020-06-12T02:38:48.951 INFO:teuthology.orchestra.run.smithi124.stdout: 2020-06-12T02:38:48.952 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 50 M 2020-06-12T02:38:48.952 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 64 M 2020-06-12T02:38:48.952 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2020-06-12T02:38:48.953 INFO:teuthology.orchestra.run.smithi124.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2020-06-12T02:38:50.609 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2020-06-12T02:38:50.809 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2020-06-12T02:38:51.770 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2020-06-12T02:38:51.770 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2020-06-12T02:39:23.816 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-06-12T02:39:23.818 DEBUG:teuthology.task.console_log:Killing console logger for smithi124 2020-06-12T02:39:23.820 DEBUG:teuthology.task.console_log:Killing console logger for smithi093 2020-06-12T02:39:23.820 DEBUG:teuthology.task.console_log:Killing console logger for smithi171 2020-06-12T02:39:23.820 DEBUG:teuthology.task.console_log:Killing console logger for smithi124 2020-06-12T02:39:23.821 DEBUG:teuthology.task.console_log:Killing console logger for smithi093 2020-06-12T02:39:23.821 DEBUG:teuthology.task.console_log:Killing console logger for smithi171 2020-06-12T02:39:23.821 DEBUG:teuthology.exit:Finished running handlers